OpenCompass/opencompass/openicl
Fengzhe Zhou 7505b3cadf
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot

* add huggingface_above_v4_33 classes

* use num_worker partitioner in cli

* update theoremqa

* update TheoremQA

* add TheoremQA

* rename theoremqa -> TheoremQA

* update TheoremQA output path

* rewrite many model configs

* update huggingface

* further update

* refine configs

* update configs

* update configs

* add configs/eval_llama3_instruct.py

* add summarizer multi faceted

* update bbh datasets

* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py

* rename class

* update readme

* update hf above v4.33
2024-05-14 14:50:16 +08:00
..
icl_evaluator [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
icl_inferencer [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
icl_retriever [Feature] Add support for MiniMax API (#548) 2023-11-06 21:57:32 +08:00
utils [Enhancement] Test linting in CI and fix existing linting errors (#69) 2023-07-17 15:59:10 +08:00
__init__.py [Enhancement] Test linting in CI and fix existing linting errors (#69) 2023-07-17 15:59:10 +08:00
icl_dataset_reader.py [Sync] Initial support of subjective evaluation (#421) 2023-09-22 15:42:31 +08:00
icl_prompt_template.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00