OpenCompass/opencompass
Shudong Liu 412199f802
[Feature] Support OlympiadBench Benchmark (#1841)
* Support OlympiadBench Benchmark

* Support OlympiadBench Benchmark

* Support OlympiadBench Benchmark

* update dataset path

* Update olmpiadBench

* Update olmpiadBench

* Update olmpiadBench

---------

Co-authored-by: liushz <qq1791167085@163.com>
2025-01-24 10:00:01 +08:00
..
cli [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
configs [Feature] Support OlympiadBench Benchmark (#1841) 2025-01-24 10:00:01 +08:00
datasets [Feature] Support OlympiadBench Benchmark (#1841) 2025-01-24 10:00:01 +08:00
evaluator [Update] Update o1 eval prompt (#1806) 2025-01-07 00:14:32 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Feature] Support Omni-Math (#1837) 2025-01-23 18:36:54 +08:00
openicl [Feature] Added Bradley-Terry subjective evaluation 2024-12-31 11:01:23 +08:00
partitioners [Fix] fix duplicate error in partitioner (#1552) 2024-09-23 19:45:21 +08:00
runners [Update] Volc status exception handle (#1780) 2024-12-26 15:43:24 +08:00
summarizers added predicted win rates reporting to bradley terry subj eval methods with an option to switch between win rates and elo ratings (#1815) 2025-01-10 18:20:25 +08:00
tasks [Fix] Fix generic_llm_evaluator output_path (#1798) 2024-12-31 13:05:05 +08:00
utils [Feature] Support OlympiadBench Benchmark (#1841) 2025-01-24 10:00:01 +08:00
__init__.py [Bump] Bump version to 0.4.0 (#1838) 2025-01-22 11:41:46 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00