8 Commits

Author	SHA1	Message	Date
Jingming	76a95e9e81	[Feature] Support the use of humaneval_plus. (#720) ... * [Feature] Support the use of humaneval_plus. * [Feature] Add humaneval_plus_gen.py * minor check * [Fix] Fix bug --------- Co-authored-by: yingfhu <yingfhu@gmail.com>	2023-12-20 17:25:17 +08:00
Jingming	dd4318f6ab	[Feature] enhance the ability of humaneval_postprocess (#676) ... * [Feature] enhance the ability of humaneval_postprocess * refactor * [Feature] Keep the old version of the function and realize the new function in humaneval_postprocess_v2. * Update opencompass/datasets/humaneval.py --------- Co-authored-by: Leymore <zfz-960727@163.com> Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>	2023-12-11 14:39:56 +08:00
Fengzhe Zhou	9083dea683	[Sync] some renaming (#641)	2023-11-27 16:06:49 +08:00
Hubert	91fba2c2e9	[Feat] support humaneval and mbpp pass@k (#598) ... * [Feat] support pass@ k * [Feat] support pass@k * [Feat] support pass@k * [Feat] support pass@k * [Feat] support pass@k * [Feat] support pass@k docs * update naming --------- Co-authored-by: Leymore <zfz-960727@163.com>	2023-11-16 21:22:06 +08:00
Fengzhe Zhou	689ffe5b63	[Feature] Use dataset in local path (#570) ... * update commonsenseqa * update drop * update flores_first100 * update gsm8k * update humaneval * update lambda * update obqa * update piqa * update race * update siqa * update story_cloze * update strategyqa * update tydiqa * update winogrande * update doc * update hellaswag * fix obqa * update collections * update .zip name	2023-11-13 13:00:37 +08:00
Tong Gao	2931f3dcb8	[Enhancement] Add humaneval postprocessor for GPT models & eval config for GPT4, enhance the original humaneval postprocessor (#129) ... * [Enhancement] Enhance humaneval postprocessor * add human-eval testcase * update * update --------- Co-authored-by: Leymore <zfz-960727@163.com>	2023-08-10 16:31:12 +08:00
Leymore	86d5ec3d0f	Update configs (#9) ... * Update implements * Update	2023-07-06 12:27:41 +08:00
gaotongxiao	7d346000bb	initial commit	2023-07-04 21:34:55 +08:00