OpenCompass/opencompass
Kangreen 59e49aedf1
[Feature] Support SuperGPQA (#1924)
* support supergpqa

* remove unnecessary code

* remove unnecessary code

* Add Readme

* Add Readme

* fix lint

* fix lint

* update

* update

---------

Co-authored-by: mkj3085003 <mkj3085003@gmail.com>
Co-authored-by: MaiziXiao <xxllcc1993@gmail.com>
2025-03-11 19:32:08 +08:00
..
cli [Fix] Fix CLI option for results persistence (#1920) 2025-03-07 18:24:30 +08:00
configs [Feature] Support SuperGPQA (#1924) 2025-03-11 19:32:08 +08:00
datasets [Feature] Support SuperGPQA (#1924) 2025-03-11 19:32:08 +08:00
evaluator [Update] Update o1 eval prompt (#1806) 2025-01-07 00:14:32 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Update] Support OlympiadBench-Math/OmniMath/LiveMathBench-Hard (#1899) 2025-03-03 18:56:11 +08:00
openicl [Feature] Support SuperGPQA (#1924) 2025-03-11 19:32:08 +08:00
partitioners [Feature] Evaluation Results Persistence (#1894) 2025-03-05 18:33:34 +08:00
runners [CI] update daily test scores (#1870) 2025-02-20 14:08:18 +08:00
summarizers [Update] OpenAI model update, bigcodebench update (#1879) 2025-02-20 19:33:25 +08:00
tasks [Feature] Support Dataset Repeat and G-Pass Compute for Each Evaluator (#1886) 2025-02-26 19:43:12 +08:00
utils [Fix] Fix CLI option for results persistence (#1920) 2025-03-07 18:24:30 +08:00
__init__.py [Bump] Bump version to 0.4.1 2025-03-04 18:26:14 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00