OpenCompass/opencompass/models
Songyang Zhang a7bacfdf7e
[Feature] Update CoreBench 2.0 (#1566)
* [Feature] 1. Update CoreBench Base\n 2. Fix lint issue in BalingAPI

* Update

* Update
2024-09-26 18:44:00 +08:00
..
claude_api [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
__init__.py [Feature] Update CoreBench 2.0 (#1566) 2024-09-26 18:44:00 +08:00
accessory.py [Feature] Support LLaMA2-Accessory (#732) 2024-01-02 20:48:51 +08:00
ai360_api.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
alaya.py Add support for DataCanvas Alaya LM (#612) 2023-11-21 17:51:30 +08:00
baichuan_api.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
baidu_api.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
bailing_api_oc.py [Feature] Update CoreBench 2.0 (#1566) 2024-09-26 18:44:00 +08:00
base_api.py [Feature] Support verbose for OpenAI API (#1546) 2024-09-20 17:12:52 +08:00
base.py [Feature] Support inference ppl datasets (#1315) 2024-07-22 17:59:30 +08:00
bytedance_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
claude_allesapin.py [Feature] Update pip install (#1324) 2024-07-29 18:32:50 +08:00
claude_sdk_api.py [Feature] Update pip install (#1324) 2024-07-29 18:32:50 +08:00
deepseek_api.py [Sync] update github workflow (#1156) 2024-05-14 22:42:23 +08:00
doubao_api.py Adding support for Doubao API (#1218) 2024-07-26 11:44:51 +08:00
doubao.py [Update] Compassbench v1.3 (#1396) 2024-08-12 19:09:19 +08:00
gemini_api.py [Feature] Update CHARM Memeorziation (#1230) 2024-07-26 18:42:30 +08:00
glm.py initial commit 2023-07-04 21:34:55 +08:00
huggingface_above_v4_33.py [Feature] Enable Truncation of Mid-Section for Long Prompts in huggingface_above_v4_33.py (#1373) 2024-08-09 11:36:30 +08:00
huggingface.py [Sync] update github workflow (#1156) 2024-05-14 22:42:23 +08:00
hunyuan_api.py [Update] Compassbench v1.3 (#1396) 2024-08-12 19:09:19 +08:00
intern_model.py [Fix] Fix when missing both pad and eos token (#287) 2023-08-31 16:53:39 +08:00
interntrain.py [Feature] Add Interntrain model support (#1548) 2024-09-23 19:10:26 +08:00
krgpt_api.py [Sync] Sync Internal (#941) 2024-03-04 14:42:36 +08:00
lagent.py Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
langchain.py Support GSM8k evaluation with tools by Lagent and LangChain (#277) 2023-09-22 15:28:22 +08:00
lightllm_api.py [Sync] bump version (#1204) 2024-05-28 23:09:59 +08:00
llama2.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
lmdeploy_pytorch.py update (#1522) 2024-09-12 15:00:52 +08:00
lmdeploy_tis.py [Feature] Add lmdeploy tis python backend model (#1014) 2024-04-23 14:27:11 +08:00
minimax_api.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
mistral_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
mixtral.py [Enhancement] Update API Interface and Mixtral (#681) 2023-12-10 13:29:26 +08:00
modelscope.py [Feature] support download from modelscope (#534) 2023-11-22 15:32:21 +08:00
moonshot_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
nanbeige_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
openai_api.py [Feature] Support verbose for OpenAI API (#1546) 2024-09-20 17:12:52 +08:00
pangu_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
qwen_api.py [Sync] update github workflow (#1156) 2024-05-14 22:42:23 +08:00
rendu_api.py [Feature] Add support for Rendu API (#1468) 2024-09-06 01:00:43 +08:00
sensetime_api.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
stepfun_api.py [Sync] update github workflow (#1156) 2024-05-14 22:42:23 +08:00
turbomind_api.py [Feature] Add an attribute api_key into TurboMindAPIModel default None (#1475) 2024-09-05 17:51:16 +08:00
turbomind_tis.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
turbomind_with_tf_above_v4_33.py update (#1522) 2024-09-12 15:00:52 +08:00
turbomind.py [ci] fix test env for vllm and add vllm baselines (#1481) 2024-09-04 19:24:09 +08:00
unigpt_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
vllm_with_tf_above_v4_33.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
vllm.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
xunfei_api.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
yayi_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
yi_api.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
zhipuai_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
zhipuai_v2_api.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00