jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
e076dc5acf
OpenCompass/opencompass/configs/models
History
Linchen Xiao 8e55c9c6ee
[Update] Compassbench v1.3 (#1396) 
* stash files

* compassbench subjective evaluation added

* evaluation update

* fix lint

* update docs

* Update lint

* changes saved

* changes saved

* CompassBench subjective summarizer added (#1349)

* subjective summarizer added

* fix lint

[Fix] Fix MathBench (#1351)

Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>

[Update] Update model support list (#1353)

* fix pip version

* fix pip version

* update model support

subjective summarizer updated

knowledge, math objective done (data need update)

remove secrets

objective changes saved

knowledge data added

* secrets removed

* changed added

* summarizer modified

* summarizer modified

* compassbench coding added

* fix lint

* objective summarizer updated

* compass_bench_v1.3 updated

* update files in config folder

* remove unused model

* lcbench modified

* removed model evaluation configs

* remove duplicated sdk implementation

---------

Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
2024-08-12 19:09:19 +08:00
..
accessory [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
alaya [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
aquila [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
baichuan [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
bluelm [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
chatglm [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
claude [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
codegeex2 [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
codellama [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
deepseek [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
falcon [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
gemini [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
gemma [Feature] Support OpenAI ChatCompletion (#1389) 2024-08-01 19:10:13 +08:00
hf_internlm [Fix] Fix Slurm ENV (#1392) 2024-08-06 01:35:20 +08:00
hf_llama [Update] Compassbench v1.3 (#1396) 2024-08-12 19:09:19 +08:00
internlm [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
judge_llm [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
lemur [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
lingowhale [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
mistral [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
moss [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
mpt [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
ms_internlm [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
nanbeige [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
openai [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
openbmb [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
opt [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
others [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
phi [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
pulse [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
qwen [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
rwkv [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
skywork [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
tigerbot [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
vicuna [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
wizardcoder [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
wizardlm [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
yi [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
zephyr [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00