jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

Add olymmath dataset

Browse Source
This commit is contained in:
liushz 2025-03-28 11:25:52 +00:00
parent a75b8fa98e
commit 006a70748f
1 changed files with 2 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
opencompass/configs/datasets/OlymMATH/README.md
View File

@ -1,9 +1,8 @@
# OlymMATH
[GitHub Link](https://github.com/RUCAIBox/OlymMATH)
This is a implementation of HLE dataset, which evaluates 2370 text-based questions without images. The default setting is to use LLM as a judge.
Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models
Dataset OlymMATH, please refer to the paper:
Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Models by Haoxiang Sun, Yingqian Min, Zhipeng Chen, Wayne Xin Zhao, Zheng Liu, Zhongyuan Wang, Lei Fang, and Ji-Rong Wen.
## How to eval OlymMATH with model judge