jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
d3963bceae
OpenCompass/configs/models
History
Linchen Xiao 8e55c9c6ee
[Update] Compassbench v1.3 (#1396) 
* stash files

* compassbench subjective evaluation added

* evaluation update

* fix lint

* update docs

* Update lint

* changes saved

* changes saved

* CompassBench subjective summarizer added (#1349)

* subjective summarizer added

* fix lint

[Fix] Fix MathBench (#1351)

Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>

[Update] Update model support list (#1353)

* fix pip version

* fix pip version

* update model support

subjective summarizer updated

knowledge, math objective done (data need update)

remove secrets

objective changes saved

knowledge data added

* secrets removed

* changed added

* summarizer modified

* summarizer modified

* compassbench coding added

* fix lint

* objective summarizer updated

* compass_bench_v1.3 updated

* update files in config folder

* remove unused model

* lcbench modified

* removed model evaluation configs

* remove duplicated sdk implementation

---------

Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
2024-08-12 19:09:19 +08:00
..
accessory [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
alaya [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
aquila [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
baichuan [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
bluelm [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
chatglm [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
claude [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
codegeex2 [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
codellama [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
deepseek [ci] update daily testcase (#1285) 2024-07-03 18:56:09 +08:00
falcon [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
gemini [Feature] Update CHARM Memeorziation (#1230) 2024-07-26 18:42:30 +08:00
gemma [Feature] Support OpenAI ChatCompletion (#1389) 2024-08-01 19:10:13 +08:00
hf_internlm [Fix] Fix Slurm ENV (#1392) 2024-08-06 01:35:20 +08:00
hf_llama [Update] Compassbench v1.3 (#1396) 2024-08-12 19:09:19 +08:00
internlm [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
judge_llm [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
lemur [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
lingowhale [Sync] update model configs (#574) 2023-11-13 15:15:34 +08:00
llama [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
mistral [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
moss [Fix] Fix moss template config (#897) 2024-02-21 11:19:24 +08:00
mpt [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
ms_internlm [Feature] support download from modelscope (#534) 2023-11-22 15:32:21 +08:00
nanbeige [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
openai [Feature] Update CHARM Memeorziation (#1230) 2024-07-26 18:42:30 +08:00
openbmb [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
opt [Fix] Rollback opt model configs (#1213) 2024-05-30 00:03:22 +08:00
others [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
phi [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
pulse [Feature] add support for hf_pulse_7b (#1255) 2024-07-29 19:01:52 +08:00
qwen [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
rwkv [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
skywork [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
tigerbot [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
vicuna Fix VLLM argument error (#1207) 2024-05-29 10:14:08 +08:00
wizardcoder [Format] Add config lints (#892) 2024-05-14 15:35:58 +08:00
wizardlm Fix VLLM argument error (#1207) 2024-05-29 10:14:08 +08:00
yi [Sync] bump version (#1204) 2024-05-28 23:09:59 +08:00
zephyr Fix VLLM argument error (#1207) 2024-05-29 10:14:08 +08:00