OpenCompass/opencompass/summarizers/__init__.py

# flake8: noqa: F401, E501
from .circular import CircularSummarizer  # noqa: F401
from .default import DefaultSummarizer  # noqa: F401
from .default_subjective import DefaultSubjectiveSummarizer  # noqa: F401
from .llm_compression import LLMCompressionSummarizer  # noqa: F401
from .multi_faceted import MultiFacetedSummarizer  # noqa: F401
from .subjective import *  # noqa: F401
[Feature] Add other judgelm prompts for Alignbench (#731) * add judgellm prompts * add judgelm prompts * update import info * fix situation that no abbr in config * fix situation that no abbr in config * add summarizer for other judgellm * change config name * add maxlen * add maxlen * dict assert * dict assert * fix strings * fix strings 2023-12-27 17:54:53 +08:00			`# flake8: noqa: F401, E501`
[Sync] format (#690) Co-authored-by: Leymore <zfz-960727@163.com> 2023-12-12 14:03:45 +08:00			`from .circular import CircularSummarizer # noqa: F401`
			`from .default import DefaultSummarizer # noqa: F401`
[Feature] Add Judgerbench and reorg subeval (#1593) * fix pip version * fix pip version * update (#1522) Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn> * [Feature] Update Models (#1518) * Update Models * Update * Update humanevalx * Update * Update * [Feature] Dataset prompts update for ARC, BoolQ, Race (#1527) add judgerbench and reorg sub add judgerbench and reorg subeval add judgerbench and reorg subeval * add judgerbench and reorg subeval * add judgerbench and reorg subeval * add judgerbench and reorg subeval * add judgerbench and reorg subeval --------- Co-authored-by: zhulinJulia24 <145004780+zhulinJulia24@users.noreply.github.com> Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn> Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com> Co-authored-by: Linchen Xiao <xxllcc1993@gmail.com> 2024-10-15 16:36:05 +08:00			`from .default_subjective import DefaultSubjectiveSummarizer # noqa: F401`
[Feature] Add huggingface apply_chat_template (#1098) * add TheoremQA with 5-shot * add huggingface_above_v4_33 classes * use num_worker partitioner in cli * update theoremqa * update TheoremQA * add TheoremQA * rename theoremqa -> TheoremQA * update TheoremQA output path * rewrite many model configs * update huggingface * further update * refine configs * update configs * update configs * add configs/eval_llama3_instruct.py * add summarizer multi faceted * update bbh datasets * update configs/models/hf_llama/lmdeploy_llama3_8b_instruct.py * rename class * update readme * update hf above v4.33 2024-05-14 14:50:16 +08:00			`from .llm_compression import LLMCompressionSummarizer # noqa: F401`
			`from .multi_faceted import MultiFacetedSummarizer # noqa: F401`
reorganize subject files (#801) 2024-01-16 18:03:11 +08:00			`from .subjective import * # noqa: F401`