jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
edab1c07ba
OpenCompass/configs/models
History
jxd 12b84aeb3b
[Feature] Update CHARM Memeorziation (#1230) 
* update gemini api and add gemini models

* add openai models

* update CHARM evaluation

* add CHARM memorization tasks

* add CharmMemSummarizer (output eval details for memorization-independent reasoning analysis

* update CHARM readme

---------

Co-authored-by: wujiang <wujiang@pjlab.org.cn>
2024-07-26 18:42:30 +08:00
..
accessory [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
alaya [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
aquila [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
baichuan [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
bluelm [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
chatglm [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
claude [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
codegeex2 [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
codellama [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
deepseek [ci] update daily testcase (#1285) 2024-07-03 18:56:09 +08:00
falcon [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
gemini [Feature] Update CHARM Memeorziation (#1230) 2024-07-26 18:42:30 +08:00
gemma [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
hf_internlm [Doc] quick start swap tabs (#1263) 2024-07-05 23:51:42 +08:00
hf_llama [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
internlm [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
judge_llm [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
lemur [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
lingowhale [Sync] update model configs (#574) 2023-11-13 15:15:34 +08:00
llama [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
mistral [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
moss [Fix] Fix moss template config (#897) 2024-02-21 11:19:24 +08:00
mpt [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
ms_internlm [Feature] support download from modelscope (#534) 2023-11-22 15:32:21 +08:00
nanbeige [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
openai [Feature] Update CHARM Memeorziation (#1230) 2024-07-26 18:42:30 +08:00
openbmb [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
opt [Fix] Rollback opt model configs (#1213) 2024-05-30 00:03:22 +08:00
others [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
phi [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
qwen [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
rwkv [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
skywork [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
tigerbot [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
vicuna Fix VLLM argument error (#1207) 2024-05-29 10:14:08 +08:00
wizardcoder [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
wizardlm Fix VLLM argument error (#1207) 2024-05-29 10:14:08 +08:00
yi [Sync] bump version (#1204) 2024-05-28 23:09:59 +08:00
zephyr Fix VLLM argument error (#1207) 2024-05-29 10:14:08 +08:00