OpenCompass/opencompass
Yu Sun d572761cef
Some checks failed
lint / lint (push) Has been cancelled
[Dataset] Add Smolinstruct configs (#2127)
* 0-shot Smolinstruct

Add 0-shot evaluation and postprocess functions for Smolinstruct

* fix acc postprocessor

* update 0-shot acc postprocessor

* rename 0-shot
2025-05-29 14:09:08 +08:00
..
cli [Update] Add CascadeEvaluator with Data Replica (#2022) 2025-05-20 16:46:55 +08:00
configs [Dataset] Add Smolinstruct configs (#2127) 2025-05-29 14:09:08 +08:00
datasets [Dataset] Add Smolinstruct configs (#2127) 2025-05-29 14:09:08 +08:00
evaluator [Update] Add CascadeEvaluator with Data Replica (#2022) 2025-05-20 16:46:55 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Dataset] Add SuperGPQA subfield configs (#2124) 2025-05-28 14:12:58 +08:00
openicl [Dataset] Add SuperGPQA subfield configs (#2124) 2025-05-28 14:12:58 +08:00
partitioners [Update] Add CascadeEvaluator with Data Replica (#2022) 2025-05-20 16:46:55 +08:00
runners [ci] update dlc setting (#2112) 2025-05-22 16:47:57 +08:00
summarizers [Dataset] Add SuperGPQA subfield configs (#2124) 2025-05-28 14:12:58 +08:00
tasks [Update] Add CascadeEvaluator with Data Replica (#2022) 2025-05-20 16:46:55 +08:00
utils [Dataset] Add SuperGPQA subfield configs (#2124) 2025-05-28 14:12:58 +08:00
__init__.py [BUMP] Bump version to 0.4.2 (#1997) 2025-04-02 17:47:15 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00