Fengzhe Zhou
|
a32f21a356
|
[Sync] Sync with internal codes 2024.06.28 (#1279)
|
2024-06-28 14:16:34 +08:00 |
|
Fengzhe Zhou
|
62dbf04708
|
[Sync] update github workflow (#1156)
|
2024-05-14 22:42:23 +08:00 |
|
Fengzhe Zhou
|
aa2dd2b58c
|
[Format] Add config lints (#892)
|
2024-05-14 15:35:58 +08:00 |
|
Xu Song
|
3dbba11945
|
[Feat] Support dataset_suffix check for mixed configs (#973)
* [Feat] Support dataset_suffix check for mixed configs
* update mixed suffix
* update suffix
---------
Co-authored-by: Leymore <zfz-960727@163.com>
|
2024-05-14 15:03:28 +08:00 |
|
Fengzhe Zhou
|
7505b3cadf
|
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot
* add huggingface_above_v4_33 classes
* use num_worker partitioner in cli
* update theoremqa
* update TheoremQA
* add TheoremQA
* rename theoremqa -> TheoremQA
* update TheoremQA output path
* rewrite many model configs
* update huggingface
* further update
* refine configs
* update configs
* update configs
* add configs/eval_llama3_instruct.py
* add summarizer multi faceted
* update bbh datasets
* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py
* rename class
* update readme
* update hf above v4.33
|
2024-05-14 14:50:16 +08:00 |
|
Fengzhe Zhou
|
8c85edd1cd
|
[Sync] deprecate old mbpps (#1064)
|
2024-04-19 20:49:46 +08:00 |
|
Fengzhe Zhou
|
b39f501563
|
[Sync] update taco (#1030)
|
2024-04-09 17:50:23 +08:00 |
|
Fengzhe Zhou
|
bdd85358cc
|
[Sync] update 20240308 (#953)
|
2024-03-11 22:34:19 +08:00 |
|
Fengzhe Zhou
|
b03d5dc531
|
[Sync] Sync Internal (#941)
|
2024-03-04 14:42:36 +08:00 |
|
Fengzhe Zhou
|
32f40a8f83
|
[Sync] Sync with internal codes 2023.01.08 (#777)
|
2024-01-08 14:07:24 +00:00 |
|
Yuchen Yan
|
11f3b91e78
|
[Fix] fix typos in drop prompt (#773)
Co-authored-by: yanyuchen04 <yanyuchen04@meituan.com>
|
2024-01-08 14:22:35 +08:00 |
|
Yang Yong
|
54345c56b7
|
Update LightllmApi and Fix mmlu bug (#738)
* Update LightllmApi and Fix mmlu bug
* checkout mmlu_gen_a484b3.py
---------
Co-authored-by: Leymore <zfz-960727@163.com>
|
2023-12-27 13:49:08 +08:00 |
|
Fengzhe Zhou
|
689ffe5b63
|
[Feature] Use dataset in local path (#570)
* update commonsenseqa
* update drop
* update flores_first100
* update gsm8k
* update humaneval
* update lambda
* update obqa
* update piqa
* update race
* update siqa
* update story_cloze
* update strategyqa
* update tydiqa
* update winogrande
* update doc
* update hellaswag
* fix obqa
* update collections
* update .zip name
|
2023-11-13 13:00:37 +08:00 |
|
Qing
|
229a65f305
|
[Fix] Fix typo in WSC prompt (#520)
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
|
2023-10-30 12:16:26 +08:00 |
|
Leymore
|
b48d084020
|
[Fix] update bbh implement & fix bbh suffix (#371)
|
2023-09-08 15:14:30 +08:00 |
|
Leymore
|
7ca6ba625e
|
[Feature] Add qwen & qwen-chat support (#286)
* add and apply update suffix tool
* add tool doc
* add qwen configs
* add cmmlu
* rename bbh
* update datasets
* delete
* update hf_qwen_7b.py
|
2023-08-31 11:29:05 +08:00 |
|
Tong Gao
|
fda42fd5fd
|
[Fix] wrong path in dataset collections (#272)
|
2023-08-25 15:50:30 +08:00 |
|
Hubert
|
7c393192af
|
[Fix] fix bug for postprocessor (#195)
* [Fix] fix bug for postprocessor
* minor fix
|
2023-08-11 18:41:12 +08:00 |
|
Tong Gao
|
bf79ff1c6d
|
[Feature] Add LEval datasets
Co-authored-by: kennymckormick <dhd@pku.edu.cn>
|
2023-08-11 17:38:31 +08:00 |
|
Leymore
|
14332e08fd
|
[Feature] add llama-oriented dataset configs (#82)
* add llama-oriented dataset configs
* update
* revert cvalues & update llama_example
|
2023-08-11 12:48:05 +08:00 |
|
Hubert
|
5a9539f375
|
[Feat] add safety to collections (#185)
* [Feat] add safety to collections
* minor fix
|
2023-08-11 11:19:26 +08:00 |
|
Hubert
|
b7184e9db5
|
[Refactor] Update crows-pairs evaluation (#98)
* [Refactor] Update crows-pairs evaluation
* [Refactor] Update crows-pairs evaluation
* minor
|
2023-07-26 11:21:32 +08:00 |
|
Leymore
|
86d5ec3d0f
|
Update configs (#9)
* Update implements
* Update
|
2023-07-06 12:27:41 +08:00 |
|
Tong Gao
|
16e759b996
|
Align prompt files with their hash (#1)
* fix bbh
* fix bbh
* rename
|
2023-07-05 18:28:58 +08:00 |
|
Leymore
|
c94cc94348
|
Add release contribution
|
2023-07-05 03:15:31 +00:00 |
|
Ezra-Yu
|
cbe9fe2cdb
|
Add Release Contraibution
|
2023-07-05 02:22:40 +00:00 |
|
mzr1996
|
3cfe73de3f
|
Support a batch of datasets.
|
2023-07-05 01:30:27 +00:00 |
|
yingfhu
|
fb11108723
|
[Feat] support opencompass
|
2023-07-04 22:11:33 +08:00 |
|