OpenCompass/opencompass
2025-03-04 18:26:14 +08:00
..
cli [Update] Support AIME-24 Evaluation for DeepSeek-R1 series (#1888) 2025-02-25 20:34:41 +08:00
configs [Feature] Add HLE (Humanity's Last Exam) dataset (#1902) 2025-03-04 16:42:37 +08:00
datasets [Feature] Add HLE (Humanity's Last Exam) dataset (#1902) 2025-03-04 16:42:37 +08:00
evaluator [Update] Update o1 eval prompt (#1806) 2025-01-07 00:14:32 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Update] Support OlympiadBench-Math/OmniMath/LiveMathBench-Hard (#1899) 2025-03-03 18:56:11 +08:00
openicl [Fix] Fix compatible issue 2025-03-03 15:35:57 +08:00
partitioners [Fix] fix duplicate error in partitioner (#1552) 2024-09-23 19:45:21 +08:00
runners [CI] update daily test scores (#1870) 2025-02-20 14:08:18 +08:00
summarizers [Update] OpenAI model update, bigcodebench update (#1879) 2025-02-20 19:33:25 +08:00
tasks [Feature] Support Dataset Repeat and G-Pass Compute for Each Evaluator (#1886) 2025-02-26 19:43:12 +08:00
utils [Feature] Support Dataset Repeat and G-Pass Compute for Each Evaluator (#1886) 2025-02-26 19:43:12 +08:00
__init__.py [Bump] Bump version to 0.4.1 2025-03-04 18:26:14 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00