mirror of
https://github.com/open-compass/opencompass.git
synced 2025-05-30 16:03:24 +08:00
17 lines
472 B
Markdown
17 lines
472 B
Markdown
# MBPP pro
|
|
|
|
## OC results
|
|
|
|
| model | pass@1 |
|
|
|:--------------------------:|---------:|
|
|
|qwen2.5-coder-7b-instruct-hf| 66 |
|
|
| qwen2.5-14b-instruct-hf | 64 |
|
|
| deepseek-v2-lite-chat-hf | 36 |
|
|
|
|
## CodeEval-pro results
|
|
|
|
| model | pass@1 |
|
|
|:--------------------------:|---------:|
|
|
|qwen2.5-coder-7b-instruct-hf| 65 |
|
|
| qwen2.5-14b-instruct-hf | 65 |
|
|
| deepseek-v2-lite-chat-hf | 39 | |