Junnan Liu 22a33d8759 [Update] Update LiveMathBench Hard Configs (#1826) ... * support G-Pass@k and livemathbench * fix bugs * fix comments of GPassKEvaluator * update saved details of GPassKEvaluator * update saved details of GPassKEvaluator * fix eval api configs & update openai_api for ease of debugging * update huggingface path * fix method name of G-Pass@k * fix default value of eval_model_name * refactor G-Pass@k evaluator * log generation params for each backend * fix evaluation resume * add notimplementerror * update livemathbench-hard configs * remove max_out_len from livemathbench_hard_greedy_gen_9befbf.py * remove max_out_len from livemathbench_hard_gen_9befbf.py * rename livemathbench_hard_gen_9befbf.py to livemathbench_hard_gen_353ae7.py * rename livemathbench_hard_greedy_gen_9befbf.py to livemathbench_hard_greedy_gen_353ae7.py * update livemathbench_gen_9befbf.py * remove whitespace * upload livemathbench hard configs		2025-02-25 17:24:36 +08:00
..
cli	[Feature] Support import configs/models/summarizers from whl (#1376)	2024-08-01 00:42:48 +08:00
configs	[Update] Update LiveMathBench Hard Configs (#1826)	2025-02-25 17:24:36 +08:00
datasets	[Update] Update LiveMathBench Hard Configs (#1826)	2025-02-25 17:24:36 +08:00
evaluator	[Update] Update o1 eval prompt (#1806)	2025-01-07 00:14:32 +08:00
lagent	Update CIBench (#1089)	2024-04-26 18:46:02 +08:00
metrics	[Feat] Support multi-modal evaluation on MME benchmark. (#197)	2023-08-21 15:53:20 +08:00
models	[Update] Update LiveMathBench Hard Configs (#1826)	2025-02-25 17:24:36 +08:00
openicl	[Feature] Math Verify with model post_processor (#1881)	2025-02-20 19:32:12 +08:00
partitioners	[Fix] fix duplicate error in partitioner (#1552)	2024-09-23 19:45:21 +08:00
runners	[CI] update daily test scores (#1870)	2025-02-20 14:08:18 +08:00
summarizers	[Update] OpenAI model update, bigcodebench update (#1879)	2025-02-20 19:33:25 +08:00
tasks	[Feature] Math Verify with model post_processor (#1881)	2025-02-20 19:32:12 +08:00
utils	[Feature] Math Verify with model post_processor (#1881)	2025-02-20 19:32:12 +08:00
__init__.py	[Bump] Bump version to 0.4.0 (#1838)	2025-01-22 11:41:46 +08:00
registry.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00