Fengzhe Zhou
|
7505b3cadf
|
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot
* add huggingface_above_v4_33 classes
* use num_worker partitioner in cli
* update theoremqa
* update TheoremQA
* add TheoremQA
* rename theoremqa -> TheoremQA
* update TheoremQA output path
* rewrite many model configs
* update huggingface
* further update
* refine configs
* update configs
* update configs
* add configs/eval_llama3_instruct.py
* add summarizer multi faceted
* update bbh datasets
* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py
* rename class
* update readme
* update hf above v4.33
|
2024-05-14 14:50:16 +08:00 |
|
Fengzhe Zhou
|
8c85edd1cd
|
[Sync] deprecate old mbpps (#1064)
|
2024-04-19 20:49:46 +08:00 |
|
Yang Yong
|
54345c56b7
|
Update LightllmApi and Fix mmlu bug (#738)
* Update LightllmApi and Fix mmlu bug
* checkout mmlu_gen_a484b3.py
---------
Co-authored-by: Leymore <zfz-960727@163.com>
|
2023-12-27 13:49:08 +08:00 |
|
Fengzhe Zhou
|
689ffe5b63
|
[Feature] Use dataset in local path (#570)
* update commonsenseqa
* update drop
* update flores_first100
* update gsm8k
* update humaneval
* update lambda
* update obqa
* update piqa
* update race
* update siqa
* update story_cloze
* update strategyqa
* update tydiqa
* update winogrande
* update doc
* update hellaswag
* fix obqa
* update collections
* update .zip name
|
2023-11-13 13:00:37 +08:00 |
|
Qing
|
229a65f305
|
[Fix] Fix typo in WSC prompt (#520)
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
|
2023-10-30 12:16:26 +08:00 |
|
Leymore
|
b48d084020
|
[Fix] update bbh implement & fix bbh suffix (#371)
|
2023-09-08 15:14:30 +08:00 |
|
Hubert
|
7c393192af
|
[Fix] fix bug for postprocessor (#195)
* [Fix] fix bug for postprocessor
* minor fix
|
2023-08-11 18:41:12 +08:00 |
|
Tong Gao
|
bf79ff1c6d
|
[Feature] Add LEval datasets
Co-authored-by: kennymckormick <dhd@pku.edu.cn>
|
2023-08-11 17:38:31 +08:00 |
|
Hubert
|
5a9539f375
|
[Feat] add safety to collections (#185)
* [Feat] add safety to collections
* minor fix
|
2023-08-11 11:19:26 +08:00 |
|
Hubert
|
b7184e9db5
|
[Refactor] Update crows-pairs evaluation (#98)
* [Refactor] Update crows-pairs evaluation
* [Refactor] Update crows-pairs evaluation
* minor
|
2023-07-26 11:21:32 +08:00 |
|
Leymore
|
86d5ec3d0f
|
Update configs (#9)
* Update implements
* Update
|
2023-07-06 12:27:41 +08:00 |
|
Tong Gao
|
16e759b996
|
Align prompt files with their hash (#1)
* fix bbh
* fix bbh
* rename
|
2023-07-05 18:28:58 +08:00 |
|
Ezra-Yu
|
cbe9fe2cdb
|
Add Release Contraibution
|
2023-07-05 02:22:40 +00:00 |
|