OpenCompass/configs/datasets
Leymore 14332e08fd
[Feature] add llama-oriented dataset configs (#82)
* add llama-oriented dataset configs

* update

* revert cvalues & update llama_example
2023-08-11 12:48:05 +08:00
..
agieval [Fix] Fix AGIEval multiple choice (#137) 2023-08-10 11:38:24 +08:00
anli [Feature] Add Xiezhi SQuAD2.0 ANLI (#101) 2023-08-10 14:04:18 +08:00
apps Update configs (#9) 2023-07-06 12:27:41 +08:00
ARC_c [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
ARC_e [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
bbh Update configs (#9) 2023-07-06 12:27:41 +08:00
ceval Update configs (#9) 2023-07-06 12:27:41 +08:00
civilcomments [Feat] add safety to collections (#185) 2023-08-11 11:19:26 +08:00
CLUE_afqmc Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_C3 Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_cmnli Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_CMRC Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_DRCD Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_ocnli Update configs (#9) 2023-07-06 12:27:41 +08:00
cmmlu [Feature] Add CMMLU dataset (#91) 2023-07-25 10:14:27 +08:00
collections [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
commonsenseqa Update configs (#9) 2023-07-06 12:27:41 +08:00
crowspairs [Refactor] Update crows-pairs evaluation (#98) 2023-07-26 11:21:32 +08:00
cvalues [Feat] Support CValues Responsibility dataset (#78) 2023-07-18 18:45:15 +08:00
drop Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
FewCLUE_bustm Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_chid [Feature] Add logger info and remove dataset bugs (#61) 2023-07-17 14:26:30 +08:00
FewCLUE_cluewsc Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_csl Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_eprstmt Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_ocnli_fc Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_tnews Update configs (#9) 2023-07-06 12:27:41 +08:00
flores Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
GaokaoBench Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
glm [Enhancement] Add humaneval postprocessor for GPT models & eval config for GPT4, enhance the original humaneval postprocessor (#129) 2023-08-10 16:31:12 +08:00
govrepcrs Update configs (#9) 2023-07-06 12:27:41 +08:00
gsm8k [Feature] Add SC (#126) 2023-07-28 17:29:37 +08:00
hellaswag [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
humaneval [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
iwslt2017 Update configs (#9) 2023-07-06 12:27:41 +08:00
jigsawmultilingual [Feat] add safety to collections (#185) 2023-08-11 11:19:26 +08:00
lambada Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
lcsts Update configs (#9) 2023-07-06 12:27:41 +08:00
math Update configs (#9) 2023-07-06 12:27:41 +08:00
mbpp Update configs (#9) 2023-07-06 12:27:41 +08:00
mmlu Update configs (#9) 2023-07-06 12:27:41 +08:00
narrativeqa Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
nq [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
obqa [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
piqa [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
PJExam Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
qabench Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
qasper Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
qaspercut Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
race [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
realtoxicprompts [Feat] add safety to collections (#185) 2023-08-11 11:19:26 +08:00
safety Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
siqa [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
squad20 [Feature] Add Xiezhi SQuAD2.0 ANLI (#101) 2023-08-10 14:04:18 +08:00
storycloze Update configs (#9) 2023-07-06 12:27:41 +08:00
strategyqa Update configs (#9) 2023-07-06 12:27:41 +08:00
summedits Update configs (#9) 2023-07-06 12:27:41 +08:00
summscreen Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_AX_b Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_AX_g Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_BoolQ [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
SuperGLUE_CB Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_COPA Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_MultiRC Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_ReCoRD Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_RTE Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_WiC Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_WSC [Feature] Add Xiezhi SQuAD2.0 ANLI (#101) 2023-08-10 14:04:18 +08:00
TheoremQA Update configs (#9) 2023-07-06 12:27:41 +08:00
triviaqa [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
triviaqarc Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
truthfulqa [Feat] add safety to collections (#185) 2023-08-11 11:19:26 +08:00
tydiqa [Feature] Add tydiqa-goldp (#75) 2023-07-18 14:54:35 +08:00
winograd Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
winogrande Update configs (#9) 2023-07-06 12:27:41 +08:00
XCOPA Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
xiezhi [Feature] Add Xiezhi SQuAD2.0 ANLI (#101) 2023-08-10 14:04:18 +08:00
XLSum Update configs (#9) 2023-07-06 12:27:41 +08:00
Xsum Update configs (#9) 2023-07-06 12:27:41 +08:00
z_bench Add release contribution 2023-07-05 03:15:31 +00:00