OpenCompass/opencompass/openicl/icl_inferencer
Fengzhe Zhou 7505b3cadf
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot

* add huggingface_above_v4_33 classes

* use num_worker partitioner in cli

* update theoremqa

* update TheoremQA

* add TheoremQA

* rename theoremqa -> TheoremQA

* update TheoremQA output path

* rewrite many model configs

* update huggingface

* further update

* refine configs

* update configs

* update configs

* add configs/eval_llama3_instruct.py

* add summarizer multi faceted

* update bbh datasets

* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py

* rename class

* update readme

* update hf above v4.33
2024-05-14 14:50:16 +08:00
..
__init__.py [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
icl_agent_inferencer.py [Feat] minor update agent related (#839) 2024-01-26 14:15:51 +08:00
icl_attack_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00
icl_base_inferencer.py [Sync] update (#517) 2023-10-27 20:31:22 +08:00
icl_chat_inferencer.py [Fix] Fix MultiRound Subjective Evaluation(#1043) 2024-04-22 12:06:03 +08:00
icl_clp_inferencer.py [Refactor] Move fix_id_list to Retriever (#442) 2023-10-07 12:53:41 +08:00
icl_gen_inferencer.py [Sync] Add InternLM2 Keyset Evaluation Demo (#807) 2024-01-17 13:48:12 +08:00
icl_ll_inferencer.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
icl_mink_percent_inferencer.py [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00
icl_ppl_inferencer.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
icl_ppl_only_inferencer.py [Sync] minor test (#683) 2023-12-11 17:42:53 +08:00
icl_sc_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00
icl_sw_ce_loss_inferencer.py [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
icl_tot_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00