OpenCompass/opencompass/models
Fengzhe Zhou 7505b3cadf
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot

* add huggingface_above_v4_33 classes

* use num_worker partitioner in cli

* update theoremqa

* update TheoremQA

* add TheoremQA

* rename theoremqa -> TheoremQA

* update TheoremQA output path

* rewrite many model configs

* update huggingface

* further update

* refine configs

* update configs

* update configs

* add configs/eval_llama3_instruct.py

* add summarizer multi faceted

* update bbh datasets

* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py

* rename class

* update readme

* update hf above v4.33
2024-05-14 14:50:16 +08:00
..
claude_api [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
__init__.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
accessory.py [Feature] Support LLaMA2-Accessory (#732) 2024-01-02 20:48:51 +08:00
ai360_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
alaya.py Add support for DataCanvas Alaya LM (#612) 2023-11-21 17:51:30 +08:00
baichuan_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
baidu_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
base_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
base.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
bytedance_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
gemini_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
glm.py initial commit 2023-07-04 21:34:55 +08:00
huggingface_above_v4_33.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
huggingface.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
hunyuan_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
intern_model.py [Fix] Fix when missing both pad and eos token (#287) 2023-08-31 16:53:39 +08:00
krgpt_api.py [Sync] Sync Internal (#941) 2024-03-04 14:42:36 +08:00
lagent.py Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
langchain.py Support GSM8k evaluation with tools by Lagent and LangChain (#277) 2023-09-22 15:28:22 +08:00
lightllm_api.py fix LightllmApi workers bug (#1113) 2024-04-30 22:09:22 +08:00
llama2.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
lmdeploy_pytorch.py adapt to lmdeploy v0.4.0 (#1073) 2024-04-28 19:57:40 +08:00
lmdeploy_tis.py [Feature] Add lmdeploy tis python backend model (#1014) 2024-04-23 14:27:11 +08:00
minimax_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
mistral_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
mixtral.py [Enhancement] Update API Interface and Mixtral (#681) 2023-12-10 13:29:26 +08:00
modelscope.py [Feature] support download from modelscope (#534) 2023-11-22 15:32:21 +08:00
moonshot_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
nanbeige_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
openai_api.py [Sync] deprecate old mbpps (#1064) 2024-04-19 20:49:46 +08:00
pangu_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
qwen_api.py [Sync] deprecate old mbpps (#1064) 2024-04-19 20:49:46 +08:00
sensetime_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
turbomind_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
turbomind_tis.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
turbomind.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
unigpt_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
vllm.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
xunfei_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
yayi_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
zhipuai_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
zhipuai_v2_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00