OpenCompass/opencompass
yuehua-s c492e49e79
[Update] Add o4 in OpenaiSDK (#2083)
* feature:1.add o4-mini;2.o3 or o4-mini only support temperature==1

* feature:change 4o-mini to 4o

---------

Co-authored-by: yuehuazhang <yuehuazhang@tencent.com>
2025-05-12 18:39:44 +08:00
..
cli [Feature] Make dump-eval-details default behavior (#1999) 2025-04-08 14:42:26 +08:00
configs [Dataset] Add human_eval/mbpp pro (#2092) 2025-05-12 18:38:13 +08:00
datasets [Dataset] Add human_eval/mbpp pro (#2092) 2025-05-12 18:38:13 +08:00
evaluator [Feature] Add CascadeEvaluator (#1992) 2025-04-08 11:58:14 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Update] Add o4 in OpenaiSDK (#2083) 2025-05-12 18:39:44 +08:00
openicl [Dataset] Add human_eval/mbpp pro (#2092) 2025-05-12 18:38:13 +08:00
partitioners [Feature] Evaluation Results Persistence (#1894) 2025-03-05 18:33:34 +08:00
runners [Update] Increase memory size for CPU job of VOLC Runner (#1962) 2025-03-24 11:21:14 +08:00
summarizers [CI] fix baseline score (#2000) 2025-04-03 19:32:36 +08:00
tasks [Refactor] Refactorize openicl eval task (#1990) 2025-04-09 15:52:23 +08:00
utils [Dataset] Add human_eval/mbpp pro (#2092) 2025-05-12 18:38:13 +08:00
__init__.py [BUMP] Bump version to 0.4.2 (#1997) 2025-04-02 17:47:15 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00