Fengzhe Zhou
|
32f40a8f83
|
[Sync] Sync with internal codes 2023.01.08 (#777)
|
2024-01-08 14:07:24 +00:00 |
|
liyucheng09
|
0b2863039e
|
[Feature] Contamination analysis for MMLU, Hellaswag, and ARC_c (#699)
* Contamination analysis for ARC_c, mmlu, and Hellaswag
* update `eval_contamination.py`
* update `contamination.py` summarizer
* fix `eval_contamination.py`
* add mmlu groups for contamination analysis
|
2024-01-08 15:51:48 +08:00 |
|
philipwangOvO
|
34561ececb
|
[Feature] Add InfiniteBench (#739)
* add InfiniteBench
* add InfiniteBench
---------
Co-authored-by: wangchonghua <wangchonghua@pjlab.org.cn>
|
2023-12-26 15:36:27 +08:00 |
|
Fengzhe Zhou
|
3a68083ecc
|
[Sync] update configs (#734)
|
2023-12-25 21:59:16 +08:00 |
|
Hubert
|
5e8b838f51
|
[Feat] Update math/agent (#716)
* minor add
* minor add
* minor fix
|
2023-12-19 21:20:42 +08:00 |
|
Hubert
|
e78857ac36
|
[Sync] minor test (#683)
|
2023-12-11 17:42:53 +08:00 |
|
liyucheng09
|
05bbce8b08
|
[Feature] Add Data Contamination Analysis (#639)
* add contamination analysis to ceval
* fix bugs
* add contamination docs
* to pass CI check
* update
---------
Co-authored-by: zhangyifan1 <zhangyifan1@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>
|
2023-12-08 10:00:11 +08:00 |
|
Fengzhe Zhou
|
9083dea683
|
[Sync] some renaming (#641)
|
2023-11-27 16:06:49 +08:00 |
|
Fengzhe Zhou
|
d4d1330a5a
|
[Sync] Fix cmnli, fix vicuna meta template, fix longbench postprocess and other minor fixes (#625)
|
2023-11-23 14:05:59 +08:00 |
|
liushz
|
c9c5c5d92e
|
Mathbench update postprocess (#600)
* Update mathbench
* Update mathbench
|
2023-11-20 16:48:55 +08:00 |
|
Fengzhe Zhou
|
689ffe5b63
|
[Feature] Use dataset in local path (#570)
* update commonsenseqa
* update drop
* update flores_first100
* update gsm8k
* update humaneval
* update lambda
* update obqa
* update piqa
* update race
* update siqa
* update story_cloze
* update strategyqa
* update tydiqa
* update winogrande
* update doc
* update hellaswag
* fix obqa
* update collections
* update .zip name
|
2023-11-13 13:00:37 +08:00 |
|
Leymore
|
861942ab1b
|
[Feature] Add lawbench (#460)
* add lawbench
* update requirements
* update
|
2023-10-13 06:51:36 -05:00 |
|
Leymore
|
fbf5089c40
|
[Sync] update github token (#475)
|
2023-10-13 06:50:54 -05:00 |
|
Leymore
|
9db5652638
|
[Feature] re-implement ceval load dataset (#446)
|
2023-09-27 21:18:48 +08:00 |
|
philipwangOvO
|
3bb3d330eb
|
[Sync] Update LongEval (#443)
|
2023-09-27 16:32:40 +08:00 |
|
TTTTTiam
|
2a62bea1a4
|
add evaluation of scibench (#393)
* add evaluation of scibench
* add evaluation of scibench
* update scibench
* remove scibench evaluator
---------
Co-authored-by: Leymore <zfz-960727@163.com>
|
2023-09-22 17:42:08 +08:00 |
|
Leymore
|
7ca6ba625e
|
[Feature] Add qwen & qwen-chat support (#286)
* add and apply update suffix tool
* add tool doc
* add qwen configs
* add cmmlu
* rename bbh
* update datasets
* delete
* update hf_qwen_7b.py
|
2023-08-31 11:29:05 +08:00 |
|
philipwangOvO
|
3f37c40aa3
|
[Dataset] Refactor LEval
|
2023-08-25 11:46:23 +08:00 |
|
philipwangOvO
|
655a807f4b
|
[Dataset] LongBench (#236)
Co-authored-by: wangchonghua <wangchonghua@pjlab.org.cn>
|
2023-08-21 14:15:20 +08:00 |
|
Tong Gao
|
bf79ff1c6d
|
[Feature] Add LEval datasets
Co-authored-by: kennymckormick <dhd@pku.edu.cn>
|
2023-08-11 17:38:31 +08:00 |
|
Hubert
|
5a9539f375
|
[Feat] add safety to collections (#185)
* [Feat] add safety to collections
* minor fix
|
2023-08-11 11:19:26 +08:00 |
|
Leymore
|
86d5ec3d0f
|
Update configs (#9)
* Update implements
* Update
|
2023-07-06 12:27:41 +08:00 |
|
Leymore
|
c94cc94348
|
Add release contribution
|
2023-07-05 03:15:31 +00:00 |
|
tonysy
|
e6b5bdcb87
|
OpenCompass Public MR
|
2023-07-05 03:15:21 +00:00 |
|
cky
|
36f111100f
|
update datasets
|
2023-07-05 01:45:26 +00:00 |
|
mzr1996
|
3cfe73de3f
|
Support a batch of datasets.
|
2023-07-05 01:30:27 +00:00 |
|
yingfhu
|
fb11108723
|
[Feat] support opencompass
|
2023-07-04 22:11:33 +08:00 |
|
gaotongxiao
|
7d346000bb
|
initial commit
|
2023-07-04 21:34:55 +08:00 |
|