OpenCompass/opencompass
Dongsheng Zhu 2c79dc5227
[Dataset] Add human_eval/mbpp pro (#2092)
* add bench

* update

* bug fix

* time update

* add index

* fix repeat bug
2025-05-12 18:38:13 +08:00
..
cli [Feature] Make dump-eval-details default behavior (#1999) 2025-04-08 14:42:26 +08:00
configs [Dataset] Add human_eval/mbpp pro (#2092) 2025-05-12 18:38:13 +08:00
datasets [Dataset] Add human_eval/mbpp pro (#2092) 2025-05-12 18:38:13 +08:00
evaluator [Feature] Add CascadeEvaluator (#1992) 2025-04-08 11:58:14 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Update] OpenAI SDK model reasoning content (#2078) 2025-05-07 14:06:40 +08:00
openicl [Dataset] Add human_eval/mbpp pro (#2092) 2025-05-12 18:38:13 +08:00
partitioners [Feature] Evaluation Results Persistence (#1894) 2025-03-05 18:33:34 +08:00
runners [Update] Increase memory size for CPU job of VOLC Runner (#1962) 2025-03-24 11:21:14 +08:00
summarizers [CI] fix baseline score (#2000) 2025-04-03 19:32:36 +08:00
tasks [Refactor] Refactorize openicl eval task (#1990) 2025-04-09 15:52:23 +08:00
utils [Dataset] Add human_eval/mbpp pro (#2092) 2025-05-12 18:38:13 +08:00
__init__.py [BUMP] Bump version to 0.4.2 (#1997) 2025-04-02 17:47:15 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00