Songyang Zhang
|
fd6fbf01a2
|
[Update] Support AIME-24 Evaluation for DeepSeek-R1 series (#1888)
* Update
* Update
* Update
* Update
|
2025-02-25 20:34:41 +08:00 |
|
Dongsheng Zhu
|
465e93e10e
|
[Update] Academic bench llm judge update (#1876)
* BigCodeBench update
* update LCBench
* update LCBench 2
* update code
* academicBench update
* academic bench ifeval&math update
* generic_llmjudge_aime_academic_postprocess delete
* aime delete
* postprocessors update
* ifeval delete
* update work_dir
* linting
* linting double-quote-string-fixer
* r1-distill out_len update
* fix lint
---------
Co-authored-by: MaiziXiao <xxllcc1993@gmail.com>
|
2025-02-24 15:45:24 +08:00 |
|
Linchen Xiao
|
27c916661d
|
[Feature] Math Verify with model post_processor (#1881)
* update
* [Feature] Update model post_processor
* update
* update
* update
|
2025-02-20 19:32:12 +08:00 |
|
Linchen Xiao
|
a6193b4c02
|
[Refactor] Code refactoarization (#1831)
* Update
* fix lint
* update
* fix lint
|
2025-01-20 19:17:38 +08:00 |
|
Songyang Zhang
|
8fdb72f567
|
[Update] Update o1 eval prompt (#1806)
* Update XML prediction post-process
* Update LiveMathBench
* Update LiveMathBench
* Update New O1 Evaluation
|
2025-01-07 00:14:32 +08:00 |
|
Songyang Zhang
|
98435dd98e
|
[Feature] Update o1 evaluation with JudgeLLM (#1795)
* Update Generic LLM Evaluator
* Update o1 style evaluator
|
2024-12-30 17:31:00 +08:00 |
|
Linchen Xiao
|
ebefffed61
|
[Update] Update OC academic 202412 (#1771)
* [Update] Update academic settings
* Update
* update
|
2024-12-19 18:07:34 +08:00 |
|
Linchen Xiao
|
bd7b705be4
|
[Update] Update dataset configuration with no max_out_len (#1754)
|
2024-12-11 18:20:29 +08:00 |
|
Linchen Xiao
|
0d26b348e4
|
[Feature] Add OC academic 2412 (#1750)
|
2024-12-10 21:53:06 +08:00 |
|
Songyang Zhang
|
fb43dd1906
|
[Update] Update Skywork/Qwen-QwQ (#1728)
* Update JuderBench
* Support O1-style Prompts
* Update Code
* Update OpenAI
* Update BigCodeBench
* Update BigCodeBench
* Update BigCodeBench
* Update BigCodeBench
* Update BigCodeBench
* Update
|
2024-12-05 19:30:43 +08:00 |
|
Songyang Zhang
|
f97c4eae42
|
[Update] Update Fullbench (#1712)
* Update JuderBench
* Support O1-style Prompts
* Update Code
|
2024-11-26 14:26:55 +08:00 |
|
liushz
|
e49fcfd3a3
|
[Update] Update MATH dataset with model judge (#1711)
* Update math with llm judge
* Update math with llm judge
* Update math with llm judge
* Update math with llm judge
* Update math with llm judge
|
2024-11-25 15:14:55 +08:00 |
|
Linchen Xiao
|
80e3b9ef37
|
[Update] Add math prm 800k (#1708)
|
2024-11-21 21:29:43 +08:00 |
|
liushz
|
5faee929db
|
[Feature] Add GaoKaoMath Dataset for Evaluation & MATH Model Eval Config (#1589)
* Add GaoKaoMath Dataset
* Add MATH LLM Eval
* Update GAOKAO Math Eval Dataset
* Update GAOKAO Math Eval Dataset
|
2024-10-12 19:13:06 +08:00 |
|
liushz
|
a0cfd61129
|
[Feature] Update MathBench & Math base model config (#1550)
* Update MathBench & WikiBench for FullBench
* Update MathBench & WikiBench for FullBench
* Update GPQA & MMLU_Pro
* Update MathBench & WikiBench for FullBench
* Update MathBench & WikiBench for FullBench
* Update MathBench & WikiBench for FullBench
* Update MathBench & Math base config
---------
Co-authored-by: liushz <liuhongwei@pjlab.rog.cn>
|
2024-09-23 14:03:59 +08:00 |
|
Songyang Zhang
|
46cc7894e1
|
[Feature] Support import configs/models/summarizers from whl (#1376)
* [Feature] Support import configs/models/summarizers from whl
* Update LCBench configs
* Update
* Update
* Update
* Update
* update
* Update
* Update
* Update
* Update
* Update
|
2024-08-01 00:42:48 +08:00 |
|