OpenCompass/docs/en/advanced_guides
Xingjun.Wang edab1c07ba
[Feature] Support ModelScope datasets (#1289)
* add ceval, gsm8k modelscope surpport

* update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest

* update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets

* format file

* format file

* update dataset format

* support ms_dataset

* udpate dataset for modelscope support

* merge myl_dev and update test_ms_dataset

* udpate dataset for modelscope support

* update readme

* update eval_api_zhipu_v2

* remove unused code

* add get_data_path function

* update readme

* remove tydiqa japanese subset

* add ceval, gsm8k modelscope surpport

* update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest

* update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets

* format file

* format file

* update dataset format

* support ms_dataset

* udpate dataset for modelscope support

* merge myl_dev and update test_ms_dataset

* update readme

* udpate dataset for modelscope support

* update eval_api_zhipu_v2

* remove unused code

* add get_data_path function

* remove tydiqa japanese subset

* update util

* remove .DS_Store

* fix md format

* move util into package

* update docs/get_started.md

* restore eval_api_zhipu_v2.py, add environment setting

* Update dataset

* Update

* Update

* Update

* Update

---------

Co-authored-by: Yun lin <yunlin@U-Q9X2K4QV-1904.local>
Co-authored-by: Yunnglin <mao.looper@qq.com>
Co-authored-by: Yun lin <yunlin@laptop.local>
Co-authored-by: Yunnglin <maoyl@smail.nju.edu.cn>
Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
2024-07-29 13:48:32 +08:00
..
accelerator_intro.md Add doc for accelerator function (#1252) 2024-06-24 14:53:51 +08:00
circular_eval.md [Feature] Add circular eval (#610) 2023-11-23 16:45:47 +08:00
code_eval_service.md update links and checkers (#890) 2024-03-13 11:01:35 +08:00
code_eval.md [Feature] Support ModelScope datasets (#1289) 2024-07-29 13:48:32 +08:00
contamination_eval.md [Docs] Update contamination docs (#775) 2024-01-08 16:37:28 +08:00
custom_dataset.md [Sync] update configs (#734) 2023-12-25 21:59:16 +08:00
evaluation_lightllm.md Support prompt template for LightllmApi. Update LightllmApi token bucket. (#945) 2024-03-06 15:33:53 +08:00
evaluation_turbomind.md update links and checkers (#890) 2024-03-13 11:01:35 +08:00
longeval.md [Docs] Readme in longeval (#389) 2023-09-18 17:06:00 +08:00
needleinahaystack_eval.md [Feature] Make NeedleBench available on HF (#1364) 2024-07-25 19:01:56 +08:00
new_dataset.md [Docs] update invalid link in docs (#499) 2023-10-25 13:15:42 +08:00
new_model.md [Docs] add en docs (#15) 2023-07-06 12:58:44 +08:00
objective_judgelm_evaluation.md [Fix] Fix Math Evaluation with Judge Model Evaluator & Add README (#1103) 2024-04-28 21:58:58 +08:00
prompt_attack.md [Feat] implementation for support promptbench (#239) 2023-09-15 15:06:53 +08:00
subjective_evaluation.md [Fix] minor update wildbench (#1335) 2024-07-26 11:19:04 +08:00