20 Commits

Author	SHA1	Message	Date
Xingjun.Wang	edab1c07ba	[Feature] Support ModelScope datasets (#1289) ... * add ceval, gsm8k modelscope surpport * update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest * update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets * format file * format file * update dataset format * support ms_dataset * udpate dataset for modelscope support * merge myl_dev and update test_ms_dataset * udpate dataset for modelscope support * update readme * update eval_api_zhipu_v2 * remove unused code * add get_data_path function * update readme * remove tydiqa japanese subset * add ceval, gsm8k modelscope surpport * update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest * update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets * format file * format file * update dataset format * support ms_dataset * udpate dataset for modelscope support * merge myl_dev and update test_ms_dataset * update readme * udpate dataset for modelscope support * update eval_api_zhipu_v2 * remove unused code * add get_data_path function * remove tydiqa japanese subset * update util * remove .DS_Store * fix md format * move util into package * update docs/get_started.md * restore eval_api_zhipu_v2.py, add environment setting * Update dataset * Update * Update * Update * Update --------- Co-authored-by: Yun lin <yunlin@U-Q9X2K4QV-1904.local> Co-authored-by: Yunnglin <mao.looper@qq.com> Co-authored-by: Yun lin <yunlin@laptop.local> Co-authored-by: Yunnglin <maoyl@smail.nju.edu.cn> Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>	2024-07-29 13:48:32 +08:00
Fengzhe Zhou	a32f21a356	[Sync] Sync with internal codes 2024.06.28 (#1279)	2024-06-28 14:16:34 +08:00
Fengzhe Zhou	d59189b87f	[Doc] Update running command in README (#1206)	2024-05-30 00:06:39 +08:00
Fengzhe Zhou	2954913d9b	[Sync] bump version (#1204)	2024-05-28 23:09:59 +08:00
Jingming Zhuo	41196c48ae	Add humaneval prompt from simple_evals, openai (#1076) ... * [Feature] Add IFEval * add humaneval prompt from simple_evals, openai	2024-04-24 17:40:50 +08:00
Fengzhe Zhou	b03d5dc531	[Sync] Sync Internal (#941)	2024-03-04 14:42:36 +08:00
Fengzhe Zhou	d34ba11106	[Sync] Merge branch 'dev' into zfz/update-keyset-demo (#876)	2024-02-05 23:29:10 +08:00
Hubert	327951087f	[Feat] update code config (#749) ... * [Feat] update code dataset * [Feat] update code dataset * [Feat] update code dataset	2023-12-29 18:46:34 +08:00
Hubert	0a525985e8	[Feature] Support sanitized MBPP dataset (#745)	2023-12-27 22:17:23 +08:00
Fengzhe Zhou	3a68083ecc	[Sync] update configs (#734)	2023-12-25 21:59:16 +08:00
Fengzhe Zhou	1ea88d5822	[Sync] Bump version to 0.1.8 (#576)	2023-11-13 16:00:38 +08:00
Fengzhe Zhou	d3de5c41fb	[Sync] update model configs (#574)	2023-11-13 15:15:34 +08:00
Fengzhe Zhou	689ffe5b63	[Feature] Use dataset in local path (#570) ... * update commonsenseqa * update drop * update flores_first100 * update gsm8k * update humaneval * update lambda * update obqa * update piqa * update race * update siqa * update story_cloze * update strategyqa * update tydiqa * update winogrande * update doc * update hellaswag * fix obqa * update collections * update .zip name	2023-11-13 13:00:37 +08:00
Leymore	14332e08fd	[Feature] add llama-oriented dataset configs (#82) ... * add llama-oriented dataset configs * update * revert cvalues & update llama_example	2023-08-11 12:48:05 +08:00
Leymore	86d5ec3d0f	Update configs (#9) ... * Update implements * Update	2023-07-06 12:27:41 +08:00
Tong Gao	16e759b996	Align prompt files with their hash (#1) ... * fix bbh * fix bbh * rename	2023-07-05 18:28:58 +08:00
Leymore	c94cc94348	Add release contribution	2023-07-05 03:15:31 +00:00
cky	36f111100f	update datasets	2023-07-05 01:45:26 +00:00
yingfhu	fb11108723	[Feat] support opencompass	2023-07-04 22:11:33 +08:00
gaotongxiao	7d346000bb	initial commit	2023-07-04 21:34:55 +08:00