jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
b0bbd4a96a
OpenCompass/opencompass/configs/datasets/aime2024
History
zhanghaoyu b0bbd4a96a chore: fix line endings and formatting; add maritime_bench dataset
2025-04-10 13:40:28 +08:00
..
aime2024_0shot_nocot_gen_2b9dc2.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
aime2024_0shot_nocot_genericllmeval_academic_gen.py [Update] Academic bench llm judge update (#1876) 2025-02-24 15:45:24 +08:00
aime2024_0shot_nocot_genericllmeval_gen_2b9dc2.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
aime2024_0shot_nocot_genericllmeval_xml_gen_2b9dc2.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
aime2024_0shot_nocot_llmjudge_gen_2b9dc2.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
aime2024_gen_6e39a4.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
aime2024_gen_17d799.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
aime2024_gen.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
aime2024_llm_judge_gen.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
aime2024_llmjudge_gen_5e9f4f.py [Bug] Aime2024 config fix (#1974) 2025-03-25 17:57:11 +08:00
aime2024_llmverify_repeat8_gen_e8fcee.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
aime2024_llmverify_repeat16_gen_bf7475.py chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00
README.md chore: fix line endings and formatting; add maritime_bench dataset 2025-04-10 13:40:28 +08:00

README.md

Description

Math dataset composed of problems from AIME2024 (American Invitational Mathematics Examination 2024).

Performance

Qwen2.5-Math-72B-Instruct Qwen2.5-Math-7B-Instruct Qwen2-Math-7B-Instruct Qwen2-Math-1.5B-Instruct internlm2-math-7b
20.00 16.67 16.67 13.33 3.33
Qwen2.5-72B-Instruct Qwen2.5-7B-Instruct internlm2_5-7b-chat
31.25 26.44 9.13