OpenCompass/opencompass/datasets/lveval
Xingjun.Wang edab1c07ba
[Feature] Support ModelScope datasets (#1289)
* add ceval, gsm8k modelscope surpport

* update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest

* update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets

* format file

* format file

* update dataset format

* support ms_dataset

* udpate dataset for modelscope support

* merge myl_dev and update test_ms_dataset

* udpate dataset for modelscope support

* update readme

* update eval_api_zhipu_v2

* remove unused code

* add get_data_path function

* update readme

* remove tydiqa japanese subset

* add ceval, gsm8k modelscope surpport

* update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest

* update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets

* format file

* format file

* update dataset format

* support ms_dataset

* udpate dataset for modelscope support

* merge myl_dev and update test_ms_dataset

* update readme

* udpate dataset for modelscope support

* update eval_api_zhipu_v2

* remove unused code

* add get_data_path function

* remove tydiqa japanese subset

* update util

* remove .DS_Store

* fix md format

* move util into package

* update docs/get_started.md

* restore eval_api_zhipu_v2.py, add environment setting

* Update dataset

* Update

* Update

* Update

* Update

---------

Co-authored-by: Yun lin <yunlin@U-Q9X2K4QV-1904.local>
Co-authored-by: Yunnglin <mao.looper@qq.com>
Co-authored-by: Yun lin <yunlin@laptop.local>
Co-authored-by: Yunnglin <maoyl@smail.nju.edu.cn>
Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
2024-07-29 13:48:32 +08:00
..
__init__.py [Feature] add lveval benchmark (#914) 2024-03-04 11:22:03 +08:00
evaluators.py [Feature] add lveval benchmark (#914) 2024-03-04 11:22:03 +08:00
lveval_cmrc_mixup.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_dureader_mixup.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_factrecall_en.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_factrecall_zh.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_hotpotwikiqa_mixup.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_lic_mixup.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_loogle_CR_mixup.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_loogle_MIR_mixup.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_loogle_SD_mixup.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_multifieldqa_en_mixup.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
lveval_multifieldqa_zh_mixup.py [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00