OpenCompass/opencompass
Hoter Young 879b181c1b
add some features (#32)
* [Feature] Support answer extraction of QwQ when evaluating HuSimpleQA

* [Feature] Support mulit-language summarization in HuSimpleQASummarizer

* [Feature] Support DeepSeep-R1-Distill-Qwen_32B_turbomind
2025-02-14 20:44:53 +08:00
..
cli [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
configs add some features (#32) 2025-02-14 20:44:53 +08:00
datasets [Refactor] Change HuSimpleQA to subjective evaluation 2025-02-12 20:25:03 +08:00
evaluator [Update] Update o1 eval prompt (#1806) 2025-01-07 00:14:32 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Feature] Support DeepSeep-R1 API from SenseTime (#29) 2025-02-13 20:50:57 +08:00
openicl [Feature] Added Bradley-Terry subjective evaluation 2024-12-31 11:01:23 +08:00
partitioners [Feature] Add OpenHuEval-HuLifeQA (#4) 2025-01-24 10:32:17 +08:00
runners [Update] Volc status exception handle (#1780) 2024-12-26 15:43:24 +08:00
summarizers add some features (#32) 2025-02-14 20:44:53 +08:00
tasks [Fix] Fix generic_llm_evaluator output_path (#1798) 2024-12-31 13:05:05 +08:00
utils add some features (#32) 2025-02-14 20:44:53 +08:00
__init__.py [Bump] Bump version to 0.4.0 (#1838) 2025-01-22 11:41:46 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00