jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
645c5f3b2c
OpenCompass/opencompass/configs/datasets/cmo_fib/README.md
Junnan Liu 645c5f3b2c
[Datasets] Add datasets CMO&AIME (#1610) 
* add datasets cmo&aime

* delete unused modules

* modify prompt

* update __init__

* update data load and add README

* update data load

* update performance

* update md5

* remove indents

* add indent

* fix log for debug mode
2024-10-28 18:08:02 +08:00

503 B
Raw Blame History

Description

Math dataset composed of problems from CMO (Chinese Mathematical Olympiad) 2009-2022 .

Performance

Qwen2.5-Math-72B-Instruct Qwen2.5-Math-7B-Instruct Qwen2-Math-7B-Instruct Qwen2-Math-1.5B-Instruct internlm2-math-7b
46.15 42.79 31.73 23.56 3.37
Qwen2.5-72B-Instruct Qwen2.5-7B-Instruct internlm2_5-7b-chat
20.00 16.67 6.67