OpenCompass/configs/datasets
Tong Gao c00179d46b
[Feature] Evaluating acc based on minimum edit distance, update SIQA (#130)
* [Feature] Support evaluating acc based on minimum edit distance, update SIQA

* update
2023-08-01 14:24:27 +08:00
..
agieval Update configs (#9) 2023-07-06 12:27:41 +08:00
apps Update configs (#9) 2023-07-06 12:27:41 +08:00
ARC_c Update configs (#9) 2023-07-06 12:27:41 +08:00
ARC_e Update configs (#9) 2023-07-06 12:27:41 +08:00
bbh Update configs (#9) 2023-07-06 12:27:41 +08:00
ceval Update configs (#9) 2023-07-06 12:27:41 +08:00
civilcomments Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
CLUE_afqmc Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_C3 Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_cmnli Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_CMRC Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_DRCD Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_ocnli Update configs (#9) 2023-07-06 12:27:41 +08:00
cmmlu [Feature] Add CMMLU dataset (#91) 2023-07-25 10:14:27 +08:00
collections [Refactor] Update crows-pairs evaluation (#98) 2023-07-26 11:21:32 +08:00
commonsenseqa Update configs (#9) 2023-07-06 12:27:41 +08:00
crowspairs [Refactor] Update crows-pairs evaluation (#98) 2023-07-26 11:21:32 +08:00
cvalues [Feat] Support CValues Responsibility dataset (#78) 2023-07-18 18:45:15 +08:00
drop Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
FewCLUE_bustm Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_chid [Feature] Add logger info and remove dataset bugs (#61) 2023-07-17 14:26:30 +08:00
FewCLUE_cluewsc Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_csl Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_eprstmt Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_ocnli_fc Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_tnews Update configs (#9) 2023-07-06 12:27:41 +08:00
flores Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
GaokaoBench Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
glm Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
govrepcrs Update configs (#9) 2023-07-06 12:27:41 +08:00
gsm8k [Feature] Add SC (#126) 2023-07-28 17:29:37 +08:00
hellaswag Update configs (#9) 2023-07-06 12:27:41 +08:00
humaneval Update configs (#9) 2023-07-06 12:27:41 +08:00
iwslt2017 Update configs (#9) 2023-07-06 12:27:41 +08:00
jigsawmultilingual Update configs (#9) 2023-07-06 12:27:41 +08:00
lambada Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
lcsts Update configs (#9) 2023-07-06 12:27:41 +08:00
math Update configs (#9) 2023-07-06 12:27:41 +08:00
mbpp Update configs (#9) 2023-07-06 12:27:41 +08:00
mmlu Update configs (#9) 2023-07-06 12:27:41 +08:00
narrativeqa Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
nq Update configs (#9) 2023-07-06 12:27:41 +08:00
obqa Update configs (#9) 2023-07-06 12:27:41 +08:00
piqa Update configs (#9) 2023-07-06 12:27:41 +08:00
PJExam Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
qabench Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
qasper Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
qaspercut Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
race Update configs (#9) 2023-07-06 12:27:41 +08:00
realtoxicprompts Update configs (#9) 2023-07-06 12:27:41 +08:00
safety Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
siqa [Feature] Evaluating acc based on minimum edit distance, update SIQA (#130) 2023-08-01 14:24:27 +08:00
storycloze Update configs (#9) 2023-07-06 12:27:41 +08:00
strategyqa Update configs (#9) 2023-07-06 12:27:41 +08:00
summedits Update configs (#9) 2023-07-06 12:27:41 +08:00
summscreen Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_AX_b Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_AX_g Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_BoolQ Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_CB Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_COPA Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_MultiRC Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_ReCoRD Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_RTE Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_WiC Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_WSC Update configs (#9) 2023-07-06 12:27:41 +08:00
TheoremQA Update configs (#9) 2023-07-06 12:27:41 +08:00
triviaqa Update configs (#9) 2023-07-06 12:27:41 +08:00
triviaqarc Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
truthfulqa Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
tydiqa [Feature] Add tydiqa-goldp (#75) 2023-07-18 14:54:35 +08:00
winograd Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
winogrande Update configs (#9) 2023-07-06 12:27:41 +08:00
XCOPA Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
XLSum Update configs (#9) 2023-07-06 12:27:41 +08:00
Xsum Update configs (#9) 2023-07-06 12:27:41 +08:00
z_bench Add release contribution 2023-07-05 03:15:31 +00:00