OpenCompass/opencompass/summarizers
Fengzhe Zhou 7505b3cadf
[Feature] Add huggingface apply_chat_template (#1098)
* add TheoremQA with 5-shot

* add huggingface_above_v4_33 classes

* use num_worker partitioner in cli

* update theoremqa

* update TheoremQA

* add TheoremQA

* rename theoremqa -> TheoremQA

* update TheoremQA output path

* rewrite many model configs

* update huggingface

* further update

* refine configs

* update configs

* update configs

* add configs/eval_llama3_instruct.py

* add summarizer multi faceted

* update bbh datasets

* update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py

* rename class

* update readme

* update hf above v4.33
2024-05-14 14:50:16 +08:00
..
subjective [Fix] Fix Math Evaluation with Judge Model Evaluator & Add README (#1103) 2024-04-28 21:58:58 +08:00
__init__.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
circular.py [Feature] Add circular eval (#610) 2023-11-23 16:45:47 +08:00
default.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
llm_compression.py [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
multi_faceted.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
multi_model.py [Feature] Add multi model viz (#509) 2023-10-30 12:11:33 +08:00
needlebench.py [Fix] Fix Needlebench Summarizer (#1143) 2024-05-13 15:59:34 +08:00
summarizer_pretrain.py [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00