jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
a11cb45c83
OpenCompass/configs/datasets
History
Hubert a11cb45c83
[Feat] implementation for support promptbench (#239) 
* [Feat] support adv_glue dataset for adversarial robustness

* reorg files

* minor fix

* minor fix

* support prompt bench demo

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix

* minor fix
2023-09-15 15:06:53 +08:00
..
adv_glue [Feat] support adv_glue dataset for adversarial robustness (#205) 2023-08-16 18:42:06 +08:00
agieval [Feature] Add LEval datasets 2023-08-11 17:38:31 +08:00
anli [Feature] Add Xiezhi SQuAD2.0 ANLI (#101) 2023-08-10 14:04:18 +08:00
apps Update configs (#9) 2023-07-06 12:27:41 +08:00
ARC_c [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
ARC_e [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
bbh [Fix] update bbh implement & fix bbh suffix (#371) 2023-09-08 15:14:30 +08:00
ceval Update configs (#9) 2023-07-06 12:27:41 +08:00
civilcomments [Feat] add safety to collections (#185) 2023-08-11 11:19:26 +08:00
CLUE_afqmc Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_C3 Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_cmnli Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_CMRC Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_DRCD Update configs (#9) 2023-07-06 12:27:41 +08:00
CLUE_ocnli Update configs (#9) 2023-07-06 12:27:41 +08:00
cmb [Dataset] Add CMB (#376) 2023-09-12 19:16:41 +08:00
cmmlu [Feature] Add LEval datasets 2023-08-11 17:38:31 +08:00
collections [Fix] update bbh implement & fix bbh suffix (#371) 2023-09-08 15:14:30 +08:00
commonsenseqa Update configs (#9) 2023-07-06 12:27:41 +08:00
crowspairs [Feature] Add LEval datasets 2023-08-11 17:38:31 +08:00
cvalues [Feature] Add LEval datasets 2023-08-11 17:38:31 +08:00
drop Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
ds1000 [Feat] support ds1000 dataset (#395) 2023-09-15 12:50:27 +08:00
FewCLUE_bustm Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_chid [Feature] Add logger info and remove dataset bugs (#61) 2023-07-17 14:26:30 +08:00
FewCLUE_cluewsc Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_csl Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_eprstmt Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_ocnli_fc Update configs (#9) 2023-07-06 12:27:41 +08:00
FewCLUE_tnews Update configs (#9) 2023-07-06 12:27:41 +08:00
flores Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
game24 [Feature] Add and apply update suffix tool (#280) 2023-08-28 17:35:04 +08:00
GaokaoBench Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
govrepcrs Update configs (#9) 2023-07-06 12:27:41 +08:00
gsm8k [Feature] Add SC (#126) 2023-07-28 17:29:37 +08:00
hellaswag [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
humaneval [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
humanevalx [Feat] support wizardcoder series (#344) 2023-09-06 17:52:35 +08:00
iwslt2017 Update configs (#9) 2023-07-06 12:27:41 +08:00
jigsawmultilingual [Feat] add safety to collections (#185) 2023-08-11 11:19:26 +08:00
lambada Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
lcsts Update configs (#9) 2023-07-06 12:27:41 +08:00
leval [Dataset] Refactor LEval 2023-08-25 11:46:23 +08:00
longbench [Dataset] Refactor LEval 2023-08-25 11:46:23 +08:00
math Update configs (#9) 2023-07-06 12:27:41 +08:00
mbpp [Feat] support wizardcoder series (#344) 2023-09-06 17:52:35 +08:00
mmlu Update configs (#9) 2023-07-06 12:27:41 +08:00
narrativeqa Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
nq [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
obqa [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
piqa [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
PJExam Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
promptbench [Feat] implementation for support promptbench (#239) 2023-09-15 15:06:53 +08:00
qabench Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
qasper Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
qaspercut Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
race [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
realtoxicprompts [Feat] add safety to collections (#185) 2023-08-11 11:19:26 +08:00
safety Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
siqa [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
squad20 [Feature] Add Xiezhi SQuAD2.0 ANLI (#101) 2023-08-10 14:04:18 +08:00
storycloze [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
strategyqa Update configs (#9) 2023-07-06 12:27:41 +08:00
summedits Update configs (#9) 2023-07-06 12:27:41 +08:00
summscreen Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_AX_b [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
SuperGLUE_AX_g [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
SuperGLUE_BoolQ [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
SuperGLUE_CB [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
SuperGLUE_COPA [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
SuperGLUE_MultiRC [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
SuperGLUE_ReCoRD [Feature] Add qwen & qwen-chat support (#286) 2023-08-31 11:29:05 +08:00
SuperGLUE_RTE [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
SuperGLUE_WiC Update configs (#9) 2023-07-06 12:27:41 +08:00
SuperGLUE_WSC [Feature] Add Xiezhi SQuAD2.0 ANLI (#101) 2023-08-10 14:04:18 +08:00
TheoremQA Update configs (#9) 2023-07-06 12:27:41 +08:00
triviaqa [Feature] add llama-oriented dataset configs (#82) 2023-08-11 12:48:05 +08:00
triviaqarc Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
truthfulqa [Feat] add safety to collections (#185) 2023-08-11 11:19:26 +08:00
tydiqa [Feature] Add tydiqa-goldp (#75) 2023-07-18 14:54:35 +08:00
winograd Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
winogrande [Feat] update postprocessor to get first option more accurately (#193) 2023-08-11 17:33:00 +08:00
XCOPA Align prompt files with their hash (#1) 2023-07-05 18:28:58 +08:00
xiezhi [Feature] Add Xiezhi SQuAD2.0 ANLI (#101) 2023-08-10 14:04:18 +08:00
XLSum Update configs (#9) 2023-07-06 12:27:41 +08:00
Xsum Update configs (#9) 2023-07-06 12:27:41 +08:00
z_bench [Feature] Add and apply update suffix tool (#280) 2023-08-28 17:35:04 +08:00