bittersweet1999 fa54aa62f6 [Feature] Add Judgerbench and reorg subeval (#1593) ... * fix pip version * fix pip version * update (#1522) Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn> * [Feature] Update Models (#1518) * Update Models * Update * Update humanevalx * Update * Update * [Feature] Dataset prompts update for ARC, BoolQ, Race (#1527) add judgerbench and reorg sub add judgerbench and reorg subeval add judgerbench and reorg subeval * add judgerbench and reorg subeval * add judgerbench and reorg subeval * add judgerbench and reorg subeval * add judgerbench and reorg subeval --------- Co-authored-by: zhulinJulia24 <145004780+zhulinJulia24@users.noreply.github.com> Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn> Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com> Co-authored-by: Linchen Xiao <xxllcc1993@gmail.com>		2024-10-15 16:36:05 +08:00
..
__init__.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
alignbench.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
alpacaeval.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
arena_hard.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
compassbench_checklist.py	[Feature] support compassbench Checklist evaluation (#1339)	2024-07-19 16:40:44 +08:00
compassbench_control_length_bias.py	[Refactor] Reorganize subjective eval (#1284)	2024-07-05 22:11:37 +08:00
compassbench.py	[Refactor] Reorganize subjective eval (#1284)	2024-07-05 22:11:37 +08:00
corev2.py	reorganize subject files (#801)	2024-01-16 18:03:11 +08:00
creationbench.py	reorganize subject files (#801)	2024-01-16 18:03:11 +08:00
flames.py	[Fix] fix Flames (#1599)	2024-10-12 14:34:59 +08:00
fofo.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
followbench.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
judgerbench.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
mtbench101.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
mtbench.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
multiround.py	reorganize subject files (#801)	2024-01-16 18:03:11 +08:00
subjective_cmp.py	[Fix] Fix Slurm ENV (#1392)	2024-08-06 01:35:20 +08:00
utils.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
wildbench.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00