OpenCompass/opencompass
Songyang Zhang 98435dd98e
[Feature] Update o1 evaluation with JudgeLLM (#1795)
* Update Generic LLM Evaluator

* Update o1 style evaluator
2024-12-30 17:31:00 +08:00
..
cli [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
configs [Feature] Update o1 evaluation with JudgeLLM (#1795) 2024-12-30 17:31:00 +08:00
datasets [Feature] Support G-Pass@k and LiveMathBench (#1772) 2024-12-30 16:59:39 +08:00
evaluator [Feature] Update o1 evaluation with JudgeLLM (#1795) 2024-12-30 17:31:00 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Feature] Support G-Pass@k and LiveMathBench (#1772) 2024-12-30 16:59:39 +08:00
openicl [Feature] Support G-Pass@k and LiveMathBench (#1772) 2024-12-30 16:59:39 +08:00
partitioners [Fix] fix duplicate error in partitioner (#1552) 2024-09-23 19:45:21 +08:00
runners [Update] Volc status exception handle (#1780) 2024-12-26 15:43:24 +08:00
summarizers [Feature] Update o1 evaluation with JudgeLLM (#1795) 2024-12-30 17:31:00 +08:00
tasks [Feature] Update o1 evaluation with JudgeLLM (#1795) 2024-12-30 17:31:00 +08:00
utils [Fix] Fix vllm max_seq_len parameter transfer (#1745) 2024-12-16 21:44:36 +08:00
__init__.py [Bump] Bump version to 0.3.8 (#1765) 2024-12-17 19:17:18 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00