jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

Update MathBench (#1176)

Browse Source 
* Add Math Evaluation with Judge Model Evaluator

* Add Math Evaluation with Judge Model Evaluator

* Add Math Evaluation with Judge Model Evaluator

* Add Math Evaluation with Judge Model Evaluator

* Fix Llama-3 meta template

* Fix MATH with JudgeLM Evaluation

* Fix MATH with JudgeLM Evaluation

* Fix MATH with JudgeLM Evaluation

* Fix MATH with JudgeLM Evaluation

* Update acclerator

* Update MathBench

---------

Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
This commit is contained in:
liushz 2024-05-21 14:45:43 +08:00 committed by GitHub
parent 2b3d4150f3
commit 1448be00e2
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
configs/datasets/MathBench/mathbench_2024_gen_649349.py → configs/datasets/MathBench/mathbench_2024_gen_19e486.py
View File

@ -91,7 +91,7 @@ for _split in list(mathbench_sets.keys()):
), ),
), ),
retriever=dict(type=ZeroRetriever), retriever=dict(type=ZeroRetriever),
inferencer=dict(type=GenInferencer, max_out_len=512), inferencer=dict(type=GenInferencer, max_out_len=2048),
) )
mathbench_eval_cfg = dict( mathbench_eval_cfg = dict(

2
configs/datasets/MathBench/mathbench_gen.py
View File

@ -1,4 +1,4 @@
from mmengine.config import read_base from mmengine.config import read_base
with read_base(): with read_base():
from .mathbench_2024_gen_649349 import mathbench_datasets # noqa: F401, F403 from .mathbench_2024_gen_19e486 import mathbench_datasets # noqa: F401, F403