OpenCompass/opencompass
Fengzhe Zhou 7505b3cadf
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot

* add huggingface_above_v4_33 classes

* use num_worker partitioner in cli

* update theoremqa

* update TheoremQA

* add TheoremQA

* rename theoremqa -> TheoremQA

* update TheoremQA output path

* rewrite many model configs

* update huggingface

* further update

* refine configs

* update configs

* update configs

* add configs/eval_llama3_instruct.py

* add summarizer multi faceted

* update bbh datasets

* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py

* rename class

* update readme

* update hf above v4.33
2024-05-14 14:50:16 +08:00
..
cli [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
datasets [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
openicl [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
partitioners [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
runners [Fix] Fix sequential runner (#1070) 2024-04-23 11:31:10 +08:00
summarizers [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
tasks [Fix] fix alpacaeval while add caching path (#1139) 2024-05-11 14:02:26 +08:00
utils [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
__init__.py [Sync] Bump version to 0.2.4 (#1052) 2024-04-16 18:09:46 +08:00
registry.py [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00