OpenCompass/opencompass/datasets/livemathbench
Junnan Liu 22a33d8759
[Update] Update LiveMathBench Hard Configs (#1826)
* support G-Pass@k and livemathbench

* fix bugs

* fix comments of GPassKEvaluator

* update saved details of GPassKEvaluator

* update saved details of GPassKEvaluator

* fix eval api configs & update openai_api for ease of debugging

* update huggingface path

* fix method name of G-Pass@k

* fix default value of eval_model_name

* refactor G-Pass@k evaluator

* log generation params for each backend

* fix evaluation resume

* add notimplementerror

* update livemathbench-hard configs

* remove max_out_len from livemathbench_hard_greedy_gen_9befbf.py

* remove max_out_len from livemathbench_hard_gen_9befbf.py

* rename livemathbench_hard_gen_9befbf.py to livemathbench_hard_gen_353ae7.py

* rename livemathbench_hard_greedy_gen_9befbf.py to livemathbench_hard_greedy_gen_353ae7.py

* update livemathbench_gen_9befbf.py

* remove whitespace

* upload livemathbench hard configs
2025-02-25 17:24:36 +08:00
..
__init__.py [Feature] Support LiveMathBench (#1727) 2024-11-30 00:07:19 +08:00
livemathbench.py [Update] Update LiveMathBench Hard Configs (#1826) 2025-02-25 17:24:36 +08:00
prompts.py [Feature] Support LiveMathBench (#1727) 2024-11-30 00:07:19 +08:00
utils.py [Feature] Support G-Pass@k and LiveMathBench (#1772) 2024-12-30 16:59:39 +08:00