mirror of
https://github.com/open-compass/opencompass.git
synced 2025-05-30 16:03:24 +08:00
645c5f3b2c
* add datasets cmo&aime * delete unused modules * modify prompt * update __init__ * update data load and add README * update data load * update performance * update md5 * remove indents * add indent * fix log for debug mode
13 lines
503 B
Markdown
13 lines
503 B
Markdown
### Description
|
|
|
|
Math dataset composed of problems from CMO (Chinese Mathematical Olympiad) 2009-2022 .
|
|
|
|
### Performance
|
|
|
|
| Qwen2.5-Math-72B-Instruct | Qwen2.5-Math-7B-Instruct | Qwen2-Math-7B-Instruct | Qwen2-Math-1.5B-Instruct | internlm2-math-7b |
|
|
| ----------- | ----------- | ----------- | ----------- | ----------- |
|
|
| 46.15 | 42.79 | 31.73 | 23.56 | 3.37 |
|
|
|
|
| Qwen2.5-72B-Instruct | Qwen2.5-7B-Instruct | internlm2_5-7b-chat |
|
|
| ----------- | ----------- | ----------- |
|
|
| 20.00 | 16.67 | 6.67 | |