jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
b2da1c08a8
OpenCompass/opencompass/configs/datasets/cmo_fib
History
Linchen Xiao aa05993922
[Update] Add dataset configurations of no max_out_len (#1967) 
* [Update] Add dataset configurations of no max_out_len

* update test torch version

* update test torch version

* update test torch version

* update test torch version
2025-03-24 14:24:12 +08:00
..
cmo_fib_0shot_notcot_gen_4c6c29.py [Update] Update Fullbench (#1712) 2024-11-26 14:26:55 +08:00
cmo_fib_gen_2783e5.py [Update] Add dataset configurations of no max_out_len (#1967) 2025-03-24 14:24:12 +08:00
cmo_fib_gen_ace24b.py [Datasets] Add datasets CMO&AIME (#1610) 2024-10-28 18:08:02 +08:00
cmo_fib_gen.py [Datasets] Add datasets CMO&AIME (#1610) 2024-10-28 18:08:02 +08:00
README.md [Datasets] Add datasets CMO&AIME (#1610) 2024-10-28 18:08:02 +08:00

README.md

Description

Math dataset composed of problems from CMO (Chinese Mathematical Olympiad) 2009-2022 .

Performance

Qwen2.5-Math-72B-Instruct Qwen2.5-Math-7B-Instruct Qwen2-Math-7B-Instruct Qwen2-Math-1.5B-Instruct internlm2-math-7b
46.15 42.79 31.73 23.56 3.37
Qwen2.5-72B-Instruct Qwen2.5-7B-Instruct internlm2_5-7b-chat
20.00 16.67 6.67