OpenCompass/opencompass/models
jiangjin1999 8194199d79
[Feature] *_batch_generate* function, add the MultiTokenEOSCriteria (#772)
* jiangjin1999: in the _batch_generate function, add the MultiTokenEOSCriteria feature to speed up inference.

* jiangjin1999: in the _batch_generate function, add the MultiTokenEOSCriteria feature to speed up inference.

---------

Co-authored-by: jiangjin08 <jiangjin08@MBP-2F32S5MD6P-0029.local>
Co-authored-by: jiangjin08 <jiangjin08@a.sh.vip.dianping.com>
2024-01-08 16:40:02 +08:00
..
claude_api [Sync] update (#517) 2023-10-27 20:31:22 +08:00
__init__.py [Feature] Support LLaMA2-Accessory (#732) 2024-01-02 20:48:51 +08:00
accessory.py [Feature] Support LLaMA2-Accessory (#732) 2024-01-02 20:48:51 +08:00
ai360_api.py [Enhancement] Update API Interface and Mixtral (#681) 2023-12-10 13:29:26 +08:00
alaya.py Add support for DataCanvas Alaya LM (#612) 2023-11-21 17:51:30 +08:00
baichuan_api.py [Enhancement] Update API Interface and Mixtral (#681) 2023-12-10 13:29:26 +08:00
baidu_api.py [Enhancement] Update API Interface and Mixtral (#681) 2023-12-10 13:29:26 +08:00
base_api.py [Sync] minor test (#683) 2023-12-11 17:42:53 +08:00
base.py [Sync] minor test (#683) 2023-12-11 17:42:53 +08:00
bytedance_api.py [Enhancement] Update API Interface and Mixtral (#681) 2023-12-10 13:29:26 +08:00
glm.py initial commit 2023-07-04 21:34:55 +08:00
huggingface.py [Feature] *_batch_generate* function, add the MultiTokenEOSCriteria (#772) 2024-01-08 16:40:02 +08:00
intern_model.py [Fix] Fix when missing both pad and eos token (#287) 2023-08-31 16:53:39 +08:00
lagent.py [Sync] minor test (#683) 2023-12-11 17:42:53 +08:00
langchain.py Support GSM8k evaluation with tools by Lagent and LangChain (#277) 2023-09-22 15:28:22 +08:00
lightllm_api.py Update LightllmApi and Fix mmlu bug (#738) 2023-12-27 13:49:08 +08:00
llama2.py [Sync] minor test (#683) 2023-12-11 17:42:53 +08:00
minimax_api.py [API] Update API (#624) 2023-11-23 15:06:20 +08:00
mixtral.py [Enhancement] Update API Interface and Mixtral (#681) 2023-12-10 13:29:26 +08:00
modelscope.py [Feature] support download from modelscope (#534) 2023-11-22 15:32:21 +08:00
moonshot_api.py [Enhancement] Update API Interface and Mixtral (#681) 2023-12-10 13:29:26 +08:00
openai_api.py [Fix] minor fix openai (#711) 2023-12-18 15:45:31 +08:00
pangu_api.py [API] Update API (#624) 2023-11-23 15:06:20 +08:00
qwen_api.py [Feature] Add support of qwen api (#735) 2024-01-02 20:47:12 +08:00
sensetime_api.py [API] Update API (#624) 2023-11-23 15:06:20 +08:00
turbomind_api.py add turbomind restful api support (#693) 2023-12-24 01:40:00 +08:00
turbomind_tis.py [Bug] Update api with generation_kargs (#614) 2023-11-22 10:02:57 +08:00
turbomind.py [Feature] Update configs for evaluating chat models like qwen, baichuan, llama2 using turbomind backend (#721) 2023-12-21 18:22:17 +08:00
xunfei_api.py [Feature] Support 360API and FixKRetriever for CSQA dataset (#601) 2023-11-21 20:25:47 +08:00
zhipuai_api.py [Feature] Support 360API and FixKRetriever for CSQA dataset (#601) 2023-11-21 20:25:47 +08:00