OpenCompass/opencompass/configs/summarizers/OlympiadBench.py
Shudong Liu 412199f802
[Feature] Support OlympiadBench Benchmark (#1841)
* Support OlympiadBench Benchmark

* Support OlympiadBench Benchmark

* Support OlympiadBench Benchmark

* update dataset path

* Update olmpiadBench

* Update olmpiadBench

* Update olmpiadBench

---------

Co-authored-by: liushz <qq1791167085@163.com>
2025-01-24 10:00:01 +08:00

16 lines
494 B
Python

from mmengine.config import read_base
with read_base():
from .groups.OlympiadBench import OlympiadBench_summary_groups
summarizer = dict(
dataset_abbrs=[
'OlympiadBench_OE_TO_maths_en_COMP',
'OlympiadBench_OE_TO_maths_zh_COMP',
'OlympiadBench_OE_TO_maths_zh_CEE',
'OlympiadBench_OE_TO_physics_en_COMP',
'OlympiadBench_OE_TO_physics_zh_CEE'
],
summary_groups=sum([v for k, v in locals().items() if k.endswith('_summary_groups')], []),
)