mirror of
https://github.com/open-compass/opencompass.git
synced 2025-05-30 16:03:24 +08:00
17 lines
477 B
Markdown
17 lines
477 B
Markdown
|
# HumanEval pro
|
||
|
|
|
||
|
|
## OC results
|
||
|
|
|
||
|
|
| model | pass@1 |
|
||
|
|
|:--------------------------:|---------:|
|
||
|
|
|qwen2.5-coder-7b-instruct-hf| 65 |
|
||
|
|
| qwen2.5-14b-instruct-hf | 67 |
|
||
|
|
| deepseek-v2-lite-chat-hf | 35 |
|
||
|
|
|
||
|
|
## CodeEval-pro results
|
||
|
|
|
||
|
|
| model | pass@1 |
|
||
|
|
|:--------------------------:|---------:|
|
||
|
|
|qwen2.5-coder-7b-instruct-hf| 65 |
|
||
|
|
| qwen2.5-14b-instruct-hf | 65 |
|
||
|
|
| deepseek-v2-lite-chat-hf | 28 |
|