OpenCompass/aime2024 at 04b7c6f092d6dfacefb3c925953ca347be6e1593 - OpenCompass - Gitea: Git with a cup of tea

jiangzhs/OpenCompass

mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00

History

Songyang Zhang aa2b89b6f8 [Update] Add CascadeEvaluator with Data Replica (#2022 ) * Update CascadeEvaluator * Update CascadeEvaluator * Update CascadeEvaluator * Update Config * Update * Update * Update * Update * Update * Update * Update * Update * Update * Update * Update * Update * Update * Update * Update		2025-05-20 16:46:55 +08:00
..
aime2024_0shot_nocot_gen_2b9dc2.py	[Update] Update Fullbench (#1712 )	2024-11-26 14:26:55 +08:00
aime2024_0shot_nocot_genericllmeval_academic_gen.py	[Update] Academic bench llm judge update (#1876 )	2025-02-24 15:45:24 +08:00
aime2024_0shot_nocot_genericllmeval_gen_2b9dc2.py	[Feature] Update o1 evaluation with JudgeLLM (#1795 )	2024-12-30 17:31:00 +08:00
aime2024_cascade_eval_gen_5e9f4f.py	[Update] Add CascadeEvaluator with Data Replica (#2022 )	2025-05-20 16:46:55 +08:00
aime2024_gen_6e39a4.py	[Datasets] Add datasets CMO&AIME (#1610 )	2024-10-28 18:08:02 +08:00
aime2024_gen_17d799.py	[Feature] Add recommendation configs for datasets (#1937 )	2025-03-25 14:54:13 +08:00
aime2024_gen.py	[Feature] Add recommendation configs for datasets (#1937 )	2025-03-25 14:54:13 +08:00
aime2024_llmjudge_gen_5e9f4f.py	[Bug] Aime2024 config fix (#1974 )	2025-03-25 17:57:11 +08:00
aime2024_llmjudge_gen.py	[Update] Add CascadeEvaluator with Data Replica (#2022 )	2025-05-20 16:46:55 +08:00
aime2024_llmverify_repeat8_gen_e8fcee.py	[Update] Support AIME-24 Evaluation for DeepSeek-R1 series (#1888 )	2025-02-25 20:34:41 +08:00
aime2024_llmverify_repeat16_gen_bf7475.py	[Update] Support AIME-24 Evaluation for DeepSeek-R1 series (#1888 )	2025-02-25 20:34:41 +08:00
README.md	[Datasets] Add datasets CMO&AIME (#1610 )	2024-10-28 18:08:02 +08:00

README.md

Description

Math dataset composed of problems from AIME2024 (American Invitational Mathematics Examination 2024).

Performance

Qwen2.5-Math-72B-Instruct	Qwen2.5-Math-7B-Instruct	Qwen2-Math-7B-Instruct	Qwen2-Math-1.5B-Instruct	internlm2-math-7b
20.00	16.67	16.67	13.33	3.33

Qwen2.5-72B-Instruct	Qwen2.5-7B-Instruct	internlm2_5-7b-chat
31.25	26.44	9.13