Linchen Xiao
3119903840
Merge branch 'main' into SciKnowEval
2025-05-09 17:03:15 +08:00
huihui1999
44a7024ed5
[Dataset] MedCalc_Bench ( #2072 )
...
* MedCalc_Bench
* MedCal_Bench
* add hash
* fix hash
* fix comments &dataset-index yml
* fix lint
* fix lint
* fix lint
* fix lint
* fix lint
---------
Co-authored-by: Linchen Xiao <xxllcc1993@gmail.com>
2025-05-09 16:58:55 +08:00
Linchen Xiao
508e2b0cb2
[Update] Set load_from_cache_file to False ( #2085 )
2025-05-09 15:21:47 +08:00
Jin Ye
6097186a95
[Datasets] MedQA, ProteinLMBench; Add Models: huatuogpt, baichuanM1 ( #2064 )
...
* Add Datasets: MedQA, ProteinLMBench; Add Models: huatuogpt, baichuanM1
* Fix bugs for MedQA. Add info in dataset-index
* Add version code for MedQA and ProteinLMBench
* Add version code for MedQA and ProteinLMBench
2025-05-09 14:47:44 +08:00
Linchen Xiao
d72df59363
[Revert] Add Lifescience Sub-set Support for SciEval ( #2059 ) ( #2087 )
...
This reverts commit c5048bfec7
2025-05-09 14:46:27 +08:00
Linchen Xiao
e28868e72e
Merge branch 'main' into SciKnowEval
2025-05-09 14:42:44 +08:00
tcheng
c5048bfec7
[Dataset] Add Lifescience Sub-set Support for SciEval ( #2059 )
...
* style: pass all formatting hooks (yapf & quote fixer)
* revise name:Add Lifescience Sub-set Support for MMLU & SciEval (datasets + configs + loader)
* revise name:Add Lifescience SciEval (datasets + configs + loader+dataset-index.yml)
* Add Lifescience SciEval (datasets + configs + loader+dataset-index.yml)
---------
Co-authored-by: root <tangcheng231@mails.ucas.edu.cn>
2025-05-09 14:31:12 +08:00
huihui
efae720249
fix lint
2025-05-09 04:46:47 +00:00
Linchen Xiao
70192c284b
Merge branch 'main' into SciKnowEval
2025-05-09 12:19:18 +08:00
huihui1999
a7f3ac20b2
[Dataset] Add CARDBiomedBench ( #2071 )
...
* CARDBiomedBench
* fix hash
* fix dataset-index
* use official llmjudge postprocess
* use official llmjudge_postprocess
* fix lint
* fix init
2025-05-08 19:44:46 +08:00
huihui
862cf61f64
fix lint
2025-05-08 10:53:26 +00:00
Wei Li
a685ed7daf
[Dataset] Add nejm ai benchmark ( #2063 )
...
* support nejm ai benchmark
* add dataset files
* revise gen name
* revise gen name
* revise class name & remove csv file & add dataset-index.yml info
* update
* update
---------
Co-authored-by: MaiziXiao <xxllcc1993@gmail.com>
2025-05-08 16:44:05 +08:00
Jiahao Xu
9ec23c145b
[Datasets] Add ClinicBench, PubMedQA and ScienceQA ( #2061 )
...
* Add ClinicBench
* Add PubMedQA & ScienceQA & ClinicBench
* Add PubMedQA & ScienceQA & ClinicBench
* Update datasets_info & hf_path
* Update hf_path
2025-05-08 16:25:43 +08:00
huihui
26adccc20c
use official llmjudge_postprocess
2025-05-08 06:07:08 +00:00
huihui
021c0d896a
fix dataset-index.yml
2025-05-08 05:02:36 +00:00
huihui
5e8bfee3f4
fix dataset-index & use official llm_judge_postprocess
2025-05-08 04:31:11 +00:00
Dongsheng Zhu
ba0e32292c
[Feature] Support InternSandbox ( #2049 )
...
* internsandbox init
* internsandbox
* dataset_index
* dataset_index_add
2025-05-07 16:42:09 +08:00
谢昕辰
43b2c4ed76
[Fix] Update lawbench data path ( #2037 )
2025-05-07 16:18:43 +08:00
huihui
272efd7d25
SciKnowEval
2025-05-02 12:08:58 +00:00
huihui
de6e4909bd
first
2025-05-02 11:57:24 +00:00
bittersweet1999
37cbaf8d92
[Add] Add Judgerbenchv2 ( #2067 )
...
* fix pip version
* fix pip version
* add judgerbenchv2
* Update __init__.py
2025-04-30 17:12:34 +08:00
Taolin Zhang
b6148aa198
add Judgebench ( #2066 )
...
* add rewardbench
* add rewardbench
* add rmb datasets
* add rmb datasets
* add judgebench
* add judgebench
2025-04-30 15:01:10 +08:00
huihui
f931d2ca94
first
2025-04-30 05:29:40 +00:00
huihui
44aadf627b
first
2025-04-30 05:29:04 +00:00
huihui
dfa26b24bd
first
2025-04-30 05:20:38 +00:00
bittersweet1999
527a80947b
[Add] Add writingbench ( #2028 )
...
* fix pip version
* fix pip version
* add writingbench
* add writingbench
* add writingbench
* add writingbench
2025-04-29 16:29:32 +08:00
Taolin Zhang
8c74e6a39e
add RMB Bench ( #2056 )
...
* add rewardbench
* add rewardbench
* add rmb datasets
* add rmb datasets
2025-04-27 16:26:01 +08:00
Junnan Liu
97010dc4ce
[Update] Update dataset repeat concatenation ( #2039 )
2025-04-23 16:16:28 +08:00
Linchen Xiao
dcbf899369
[Bug] Fix SmolInsturct logger import ( #2036 )
2025-04-23 11:10:30 +08:00
Linchen Xiao
bf74f26603
[Update] Safe SmolInstruct meteor calculation ( #2033 )
2025-04-22 18:27:48 +08:00
Linchen Xiao
455bb05d1b
[Update] Update dataset configs ( #2030 )
...
* [Update] Update dataset configs
* Fix lint
2025-04-21 18:55:06 +08:00
Taolin Zhang
c69110361b
[Add] add rewardbench ( #2029 )
...
* add rewardbench
* add rewardbench
2025-04-21 17:18:51 +08:00
JuchengHu
a2093a81ef
[Dataset] Matbench ( #2021 )
...
* add support for matbench
* fix dataset path
* fix data load
* fix
* fix lint
---------
Co-authored-by: Jucheng Hu <jucheng.hu.20@ucl.ac.uk>
Co-authored-by: Myhs-phz <demarcia2014@126.com>
2025-04-21 15:50:47 +08:00
Linchen Xiao
b2da1c08a8
[Dataset] Add SmolInstruct, Update Chembench ( #2025 )
...
* [Dataset] Add SmolInstruct, Update Chembench
* Add dataset metadata
* update
* update
* update
2025-04-18 17:21:29 +08:00
Linchen Xiao
65ff602cf5
[Update] Fix LLM Judge metrics cacluation & Add reasoning content concat to OpenAI SDK
2025-04-15 11:33:16 +08:00
Myhs_phz
75e7834b59
[Feature] Add Datasets: ClimateQA,Physics ( #2017 )
...
* feat ClimateQA
* feat PHYSICS
* fix
* fix
* fix
* fix
2025-04-14 20:18:47 +08:00
Linchen Xiao
6a6a1a5c0b
[Feature] LLM Judge sanity check ( #2012 )
...
* update
* update
2025-04-11 19:01:39 +08:00
bittersweet1999
3f50b1dc49
[Fix] fix order bug Update arena_hard.py ( #2015 )
2025-04-11 16:59:40 +08:00
zhulinJulia24
6ac9b06bc2
[ci] update baseline for kernal change of vllm and lmdeploy ( #2011 )
...
* update
* update
* update
* update
* update
* update
* update
2025-04-09 14:09:35 +08:00
Jin Ye
b564e608b1
[Dataset] Add MedXpertQA ( #2002 )
...
* Add MedXpertQA
* Add MedXpertQA
* Add MedXpertQA
* Fix lint
---------
Co-authored-by: MaiziXiao <xxllcc1993@gmail.com>
2025-04-08 10:44:48 +08:00
shijinpjlab
828fb745c9
[Dataset] Update dingo 1.5.0 ( #2008 )
...
Co-authored-by: shiin <shijin@pjlab.org.cn>
2025-04-07 17:21:15 +08:00
liushz
32d6859679
[Feature] Add olymmath dataset ( #1982 )
...
* Add olymmath dataset
* Add olymmath dataset
* Add olymmath dataset
* Update olymmath dataset
2025-04-02 17:34:07 +08:00
Linchen Xiao
f66b0b347a
[Update] Requirements update ( #1993 )
2025-04-02 12:03:45 +08:00
Linchen Xiao
db96161a4e
[Update] Add SuperGPQA subset metrics ( #1966 )
2025-03-24 14:25:12 +08:00
Dongsheng Zhu
8a5029b121
[Feature] Add MultiPL-E & Code Evaluator ( #1963 )
...
* multiple_code develop
* multiple_code update
* comments upadate
* index upadate
2025-03-21 20:09:25 +08:00
Linchen Xiao
1c60e3a0f6
[Update] Add configurations for llmjudge dataset ( #1940 )
...
* Add configurations for llmjudge dataset
* update
2025-03-13 17:30:04 +08:00
Yufeng Zhao
bc2969dba8
[Feature] Add support for BBEH dataset ( #1925 )
...
* bbeh
* bbeh
* fix_smallbugs_bbeh
* removeprint
* results
---------
Co-authored-by: yufeng zhao <zhaoyufeng@pjlab.org.cn>
2025-03-12 10:53:31 +08:00
Kangreen
59e49aedf1
[Feature] Support SuperGPQA ( #1924 )
...
* support supergpqa
* remove unnecessary code
* remove unnecessary code
* Add Readme
* Add Readme
* fix lint
* fix lint
* update
* update
---------
Co-authored-by: mkj3085003 <mkj3085003@gmail.com>
Co-authored-by: MaiziXiao <xxllcc1993@gmail.com>
2025-03-11 19:32:08 +08:00
Dongsheng Zhu
fff2d51440
[Update] Code evaluation alignment ( #1909 )
...
* code alignment
* update oss md5
* bigcodebench update
* lint
* lint_
* lint yapf
2025-03-04 18:49:38 +08:00
liushz
198c08632e
[Feature] Add HLE (Humanity's Last Exam) dataset ( #1902 )
...
* Support OlympiadBench Benchmark
* Support OlympiadBench Benchmark
* Support OlympiadBench Benchmark
* update dataset path
* Update olmpiadBench
* Update olmpiadBench
* Update olmpiadBench
* Add HLE dataset
* Add HLE dataset
* Add HLE dataset
---------
Co-authored-by: sudanl <sudanl@foxmail.com>
2025-03-04 16:42:37 +08:00
