OpenCompass/configs/models
Fengzhe Zhou 7505b3cadf
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot

* add huggingface_above_v4_33 classes

* use num_worker partitioner in cli

* update theoremqa

* update TheoremQA

* add TheoremQA

* rename theoremqa -> TheoremQA

* update TheoremQA output path

* rewrite many model configs

* update huggingface

* further update

* refine configs

* update configs

* update configs

* add configs/eval_llama3_instruct.py

* add summarizer multi faceted

* update bbh datasets

* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py

* rename class

* update readme

* update hf above v4.33
2024-05-14 14:50:16 +08:00
..
accessory [Feature] Support LLaMA2-Accessory (#732) 2024-01-02 20:48:51 +08:00
alaya Add support for DataCanvas Alaya LM (#612) 2023-11-21 17:51:30 +08:00
aquila [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
baichuan [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
bluelm [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
chatglm [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
claude [Sync] update (#517) 2023-10-27 20:31:22 +08:00
codegeex2 [Feaure] Add new models: baichuan2, tigerbot, vicuna v1.5 (#373) 2023-09-08 15:41:20 +08:00
codellama [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
deepseek [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
falcon [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
gemini [Feature] add support for gemini (#931) 2024-02-28 19:38:34 +08:00
gemma [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
hf_internlm [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
hf_llama [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
internlm [Feaure] Add new models: baichuan2, tigerbot, vicuna v1.5 (#373) 2023-09-08 15:41:20 +08:00
judge_llm fix erro in configs (#750) 2023-12-28 11:53:07 +00:00
lemur [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00
lingowhale [Sync] update model configs (#574) 2023-11-13 15:15:34 +08:00
llama [Feaure] Add new models: baichuan2, tigerbot, vicuna v1.5 (#373) 2023-09-08 15:41:20 +08:00
mistral [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
moss [Fix] Fix moss template config (#897) 2024-02-21 11:19:24 +08:00
mpt [Feaure] Add new models: baichuan2, tigerbot, vicuna v1.5 (#373) 2023-09-08 15:41:20 +08:00
ms_internlm [Feature] support download from modelscope (#534) 2023-11-22 15:32:21 +08:00
nanbeige [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
openai [Doc] Update Doc for Alignbench (#707) 2023-12-15 15:07:25 +08:00
openbmb [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
opt [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
others [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
qwen [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
rwkv add rwkv-5-3b model (#666) 2023-12-12 18:15:19 +08:00
skywork [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
tigerbot [Sync] update model configs (#574) 2023-11-13 15:15:34 +08:00
vicuna [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
wizardcoder [Feat] support wizardcoder series (#344) 2023-09-06 17:52:35 +08:00
wizardlm [Sync] Add InternLM2 Keyset Evaluation Demo (#807) 2024-01-17 13:48:12 +08:00
yi [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
zephyr [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00