19 Commits

Author	SHA1	Message	Date
Francesco Bertolotti	5fb578aa00	timed re.search and _executor made global	2025-05-21 14:14:34 +02:00
Xingjun.Wang	edab1c07ba	[Feature] Support ModelScope datasets (#1289) ... * add ceval, gsm8k modelscope surpport * update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest * update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets * format file * format file * update dataset format * support ms_dataset * udpate dataset for modelscope support * merge myl_dev and update test_ms_dataset * udpate dataset for modelscope support * update readme * update eval_api_zhipu_v2 * remove unused code * add get_data_path function * update readme * remove tydiqa japanese subset * add ceval, gsm8k modelscope surpport * update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest * update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets * format file * format file * update dataset format * support ms_dataset * udpate dataset for modelscope support * merge myl_dev and update test_ms_dataset * update readme * udpate dataset for modelscope support * update eval_api_zhipu_v2 * remove unused code * add get_data_path function * remove tydiqa japanese subset * update util * remove .DS_Store * fix md format * move util into package * update docs/get_started.md * restore eval_api_zhipu_v2.py, add environment setting * Update dataset * Update * Update * Update * Update --------- Co-authored-by: Yun lin <yunlin@U-Q9X2K4QV-1904.local> Co-authored-by: Yunnglin <mao.looper@qq.com> Co-authored-by: Yun lin <yunlin@laptop.local> Co-authored-by: Yunnglin <maoyl@smail.nju.edu.cn> Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>	2024-07-29 13:48:32 +08:00
Fengzhe Zhou	2954913d9b	[Sync] bump version (#1204)	2024-05-28 23:09:59 +08:00
Fengzhe Zhou	2b3d4150f3	[Sync] update evaluator (#1175)	2024-05-21 14:22:46 +08:00
Fengzhe Zhou	5de85406ce	[Sync] add OC16 entry (#1171)	2024-05-17 16:50:58 +08:00
Fengzhe Zhou	80f831b425	[Fix] use ProcessPoolExecutor during mbpp eval (#1159)	2024-05-15 13:48:29 +08:00
Fengzhe Zhou	8c85edd1cd	[Sync] deprecate old mbpps (#1064)	2024-04-19 20:49:46 +08:00
Fengzhe Zhou	b39f501563	[Sync] update taco (#1030)	2024-04-09 17:50:23 +08:00
Fengzhe Zhou	bdd85358cc	[Sync] update 20240308 (#953)	2024-03-11 22:34:19 +08:00
Fengzhe Zhou	d34ba11106	[Sync] Merge branch 'dev' into zfz/update-keyset-demo (#876)	2024-02-05 23:29:10 +08:00
Fengzhe Zhou	b4afe3e7c1	[Sync] Add InternLM2 Keyset Evaluation Demo (#807) ... Co-authored-by: zhangyifan1 <zhangyifan1@pjlab.org.cn>	2024-01-17 13:48:12 +08:00
Connor-Shen	30a90d8dd8	Support Mbpp_plus dataset (#770) ... * support mbpp+ * support mbpp+ * minor fix * [Feat] minor fix --------- Co-authored-by: yingfhu <yingfhu@gmail.com>	2024-01-05 22:01:57 +08:00
Connor-Shen	81098722d2	add chinese version of humaneval, mbpp (#743) ... * add chinese_version of humaneval,mbpp * add humaneval&mbpp gen.py * minor fix * minor add --------- Co-authored-by: yingfhu <yingfhu@gmail.com>	2023-12-28 14:47:56 +08:00
Hubert	0a525985e8	[Feature] Support sanitized MBPP dataset (#745)	2023-12-27 22:17:23 +08:00
Fengzhe Zhou	9083dea683	[Sync] some renaming (#641)	2023-11-27 16:06:49 +08:00
Hubert	91fba2c2e9	[Feat] support humaneval and mbpp pass@k (#598) ... * [Feat] support pass@ k * [Feat] support pass@k * [Feat] support pass@k * [Feat] support pass@k * [Feat] support pass@k * [Feat] support pass@k docs * update naming --------- Co-authored-by: Leymore <zfz-960727@163.com>	2023-11-16 21:22:06 +08:00
Hubert	ddb8197212	[Feat] support wizardcoder series (#344) ... * [Feat] support wizardcoder series * minor fix	2023-09-06 17:52:35 +08:00
Leymore	86d5ec3d0f	Update configs (#9) ... * Update implements * Update	2023-07-06 12:27:41 +08:00
gaotongxiao	7d346000bb	initial commit	2023-07-04 21:34:55 +08:00