jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
6118596362
OpenCompass/opencompass/configs/datasets/aime2024
History
Myhs_phz 6118596362
[Feature] Add recommendation configs for datasets (#1937) 
* feat datasetrefine drop

* fix datasets in fullbench_int3

* fix

* fix

* back

* fix

* fix and doc

* feat

* fix hook

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* doc

* fix

* fix

* Update dataset-index.yml
2025-03-25 14:54:13 +08:00
..
aime2024_0shot_nocot_gen_2b9dc2.py [Update] Update Fullbench (#1712) 2024-11-26 14:26:55 +08:00
aime2024_0shot_nocot_genericllmeval_academic_gen.py [Update] Academic bench llm judge update (#1876) 2025-02-24 15:45:24 +08:00
aime2024_0shot_nocot_genericllmeval_gen_2b9dc2.py [Feature] Update o1 evaluation with JudgeLLM (#1795) 2024-12-30 17:31:00 +08:00
aime2024_0shot_nocot_genericllmeval_xml_gen_2b9dc2.py [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
aime2024_0shot_nocot_llmjudge_gen_2b9dc2.py [Update] Update Skywork/Qwen-QwQ (#1728) 2024-12-05 19:30:43 +08:00
aime2024_gen_6e39a4.py [Datasets] Add datasets CMO&AIME (#1610) 2024-10-28 18:08:02 +08:00
aime2024_gen_17d799.py [Feature] Add recommendation configs for datasets (#1937) 2025-03-25 14:54:13 +08:00
aime2024_gen.py [Feature] Add recommendation configs for datasets (#1937) 2025-03-25 14:54:13 +08:00
aime2024_llm_judge_gen.py [Feature] Add recommendation configs for datasets (#1937) 2025-03-25 14:54:13 +08:00
aime2024_llmjudge_gen_5e9f4f.py [Update] Add configurations for llmjudge dataset (#1940) 2025-03-13 17:30:04 +08:00
aime2024_llmverify_repeat8_gen_e8fcee.py [Update] Support AIME-24 Evaluation for DeepSeek-R1 series (#1888) 2025-02-25 20:34:41 +08:00
aime2024_llmverify_repeat16_gen_bf7475.py [Update] Support AIME-24 Evaluation for DeepSeek-R1 series (#1888) 2025-02-25 20:34:41 +08:00
README.md [Datasets] Add datasets CMO&AIME (#1610) 2024-10-28 18:08:02 +08:00

README.md

Description

Math dataset composed of problems from AIME2024 (American Invitational Mathematics Examination 2024).

Performance

Qwen2.5-Math-72B-Instruct Qwen2.5-Math-7B-Instruct Qwen2-Math-7B-Instruct Qwen2-Math-1.5B-Instruct internlm2-math-7b
20.00 16.67 16.67 13.33 3.33
Qwen2.5-72B-Instruct Qwen2.5-7B-Instruct internlm2_5-7b-chat
31.25 26.44 9.13