Junnan Liu f0809fe6f6 [Update] Fix Hard Configs With General GPassK (#1906) ... * support dataset repeat and g-pass compute for each evaluator * fix pre-commit errors * delete print * delete gpassk_evaluator and fix potential errors * change `repeat` to `n` * fix `repeat` to `n` in openicl_eval * update doc for multi-run and g-pass * update latex equation in doc * update eng doc for multi-run and g-pass * update datasets.md * update datasets.md * fix multi-line equation * fix multi-line equation * fix multi-line equation * fix multi-line equation * fix multi-line equation * fix multi-line equation * fix multi-line equation in zh_cn user_guides * mmodify pre-commit-zh-cn * recover pre-commit and edit math expr in doc * del [TIP] * del cite tag in doc * del extract_model param in livemathbench config * fix livemathbench hard configs		2025-03-03 18:17:15 +08:00
..
cli	[Update] Support AIME-24 Evaluation for DeepSeek-R1 series (#1888)	2025-02-25 20:34:41 +08:00
configs	[Update] Fix Hard Configs With General GPassK (#1906)	2025-03-03 18:17:15 +08:00
datasets	[Fix] Fix compatible issue	2025-03-03 15:35:57 +08:00
evaluator	[Update] Update o1 eval prompt (#1806)	2025-01-07 00:14:32 +08:00
lagent	Update CIBench (#1089)	2024-04-26 18:46:02 +08:00
metrics	[Feat] Support multi-modal evaluation on MME benchmark. (#197)	2023-08-21 15:53:20 +08:00
models	[Update] Update LiveMathBench Hard Configs (#1826)	2025-02-25 17:24:36 +08:00
openicl	[Fix] Fix compatible issue	2025-03-03 15:35:57 +08:00
partitioners	[Fix] fix duplicate error in partitioner (#1552)	2024-09-23 19:45:21 +08:00
runners	[CI] update daily test scores (#1870)	2025-02-20 14:08:18 +08:00
summarizers	[Update] OpenAI model update, bigcodebench update (#1879)	2025-02-20 19:33:25 +08:00
tasks	[Feature] Support Dataset Repeat and G-Pass Compute for Each Evaluator (#1886)	2025-02-26 19:43:12 +08:00
utils	[Feature] Support Dataset Repeat and G-Pass Compute for Each Evaluator (#1886)	2025-02-26 19:43:12 +08:00
__init__.py	[Bump] Bump version to 0.4.0 (#1838)	2025-01-22 11:41:46 +08:00
registry.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00