OpenCompass/opencompass/utils
Fengzhe Zhou 7505b3cadf
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot

* add huggingface_above_v4_33 classes

* use num_worker partitioner in cli

* update theoremqa

* update TheoremQA

* add TheoremQA

* rename theoremqa -> TheoremQA

* update TheoremQA output path

* rewrite many model configs

* update huggingface

* further update

* refine configs

* update configs

* update configs

* add configs/eval_llama3_instruct.py

* add summarizer multi faceted

* update bbh datasets

* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py

* rename class

* update readme

* update hf above v4.33
2024-05-14 14:50:16 +08:00
..
__init__.py [Feat] support humaneval and mbpp pass@k (#598) 2023-11-16 21:22:06 +08:00
abbr.py [Feature] Add multi-model judge and fix some problems (#1016) 2024-04-02 11:52:06 +08:00
auxiliary.py [Feat] support humaneval and mbpp pass@k (#598) 2023-11-16 21:22:06 +08:00
build.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
collect_env.py [Docs] add issue and pr template (#12) 2023-07-06 11:55:01 +08:00
dependency.py [Feature]: Use multimodal (#73) 2023-08-03 11:07:50 +08:00
file.py fix output typing, change mutable list to immutable tuple (#989) 2024-04-26 23:07:34 +08:00
fileio.py initial commit 2023-07-04 21:34:55 +08:00
lark.py [Feature] Several enhancements (#142) 2023-08-01 18:19:49 +08:00
logging.py [Enhance] Supress warning raised by get_logger (#353) 2023-09-04 15:27:08 +08:00
menu.py [Feat] Support local runner for windows (#515) 2023-10-27 17:16:22 +08:00
prompt.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
run.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
text_postprocessors.py [Feature] Add mmlu prompt from simple_evals, openai (#1074) 2024-05-06 13:26:26 +08:00
types.py [Sync] Initial support of subjective evaluation (#421) 2023-09-22 15:42:31 +08:00