OpenCompass/opencompass/utils/__init__.py

from .abbr import *  # noqa
from .auxiliary import *  # noqa
from .build import *  # noqa
from .collect_env import *  # noqa
from .datasets import *  # noqa
from .dependency import *  # noqa
from .dict_postprocessors import *  # noqa
from .file import *  # noqa
from .fileio import *  # noqa
from .lark import *  # noqa
from .logging import *  # noqa
from .menu import *  # noqa
from .network import *  # noqa
from .prompt import *  # noqa
from .result_station import *  # noqa
from .text_postprocessors import *  # noqa
[Feat] support opencompass 2023-07-04 22:11:33 +08:00			`from .abbr import * # noqa`
[Feat] support humaneval and mbpp pass@k (#598) * [Feat] support pass@ k * [Feat] support pass@k * [Feat] support pass@k * [Feat] support pass@k * [Feat] support pass@k * [Feat] support pass@k docs * update naming --------- Co-authored-by: Leymore <zfz-960727@163.com> 2023-11-16 21:22:06 +08:00			`from .auxiliary import * # noqa`
[Feat] support opencompass 2023-07-04 22:11:33 +08:00			`from .build import * # noqa`
[Docs] add en docs (#15) * add en docs * update --------- Co-authored-by: gaotongxiao <gaotongxiao@gmail.com> 2023-07-06 12:58:44 +08:00			`from .collect_env import * # noqa`
[Feature] Support ModelScope datasets (#1289) * add ceval, gsm8k modelscope surpport * update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest * update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets * format file * format file * update dataset format * support ms_dataset * udpate dataset for modelscope support * merge myl_dev and update test_ms_dataset * udpate dataset for modelscope support * update readme * update eval_api_zhipu_v2 * remove unused code * add get_data_path function * update readme * remove tydiqa japanese subset * add ceval, gsm8k modelscope surpport * update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest * update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets * format file * format file * update dataset format * support ms_dataset * udpate dataset for modelscope support * merge myl_dev and update test_ms_dataset * update readme * udpate dataset for modelscope support * update eval_api_zhipu_v2 * remove unused code * add get_data_path function * remove tydiqa japanese subset * update util * remove .DS_Store * fix md format * move util into package * update docs/get_started.md * restore eval_api_zhipu_v2.py, add environment setting * Update dataset * Update * Update * Update * Update --------- Co-authored-by: Yun lin <yunlin@U-Q9X2K4QV-1904.local> Co-authored-by: Yunnglin <mao.looper@qq.com> Co-authored-by: Yun lin <yunlin@laptop.local> Co-authored-by: Yunnglin <maoyl@smail.nju.edu.cn> Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn> 2024-07-29 13:48:32 +08:00			`from .datasets import * # noqa`
[Feature]: Use multimodal (#73) * [Feature]: Add minigpt-4 * [Feature]: Add mm local runner * [Feature]: Add instructblip * [Feature]: Delete redundant file * [Feature]: Delete redundant file * [Feature]: Add README to InstructBLIP * [Feature]: Update MiniGPT-4 * [Fix]: Fix lint * [Feature]add omnibenchmark readme (#49) * add omnibenchmark readme * fix * Update OmniMMBench.md * Update OmniMMBench.md * Update OmniMMBench.md * [Fix]: Refine name (#54) * [Feature]: Unify out and err * [Fix]: Fix lint * [Feature]: Rename to mmbench and change weight path * [Feature]: Delete Omni in instructblip * [Feature]: Check the avaliablity of lavis * [Fix]: Fix lint * [Feature]: Refactor MM * [Refactor]: Refactor path * [Feature]: Delete redundant files * [Refactor]: Delete redundant files --------- Co-authored-by: Wangbo Zhao(黑色枷锁) <56866854+wangbo-zhao@users.noreply.github.com> 2023-08-03 11:07:50 +08:00			`from .dependency import * # noqa`
[Feature] Add Judgerbench and reorg subeval (#1593) * fix pip version * fix pip version * update (#1522) Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn> * [Feature] Update Models (#1518) * Update Models * Update * Update humanevalx * Update * Update * [Feature] Dataset prompts update for ARC, BoolQ, Race (#1527) add judgerbench and reorg sub add judgerbench and reorg subeval add judgerbench and reorg subeval * add judgerbench and reorg subeval * add judgerbench and reorg subeval * add judgerbench and reorg subeval * add judgerbench and reorg subeval --------- Co-authored-by: zhulinJulia24 <145004780+zhulinJulia24@users.noreply.github.com> Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn> Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com> Co-authored-by: Linchen Xiao <xxllcc1993@gmail.com> 2024-10-15 16:36:05 +08:00			`from .dict_postprocessors import * # noqa`
[Feature] Simplify entry script (#204) * [Feature] Simply entry script * update 2023-08-25 17:36:30 +08:00			`from .file import * # noqa`
[Feat] support opencompass 2023-07-04 22:11:33 +08:00			`from .fileio import * # noqa`
			`from .lark import * # noqa`
			`from .logging import * # noqa`
			`from .menu import * # noqa`
[Update] Update Skywork/Qwen-QwQ (#1728) * Update JuderBench * Support O1-style Prompts * Update Code * Update OpenAI * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update BigCodeBench * Update 2024-12-05 19:30:43 +08:00			`from .network import * # noqa`
[Feat] support opencompass 2023-07-04 22:11:33 +08:00			`from .prompt import * # noqa`
[Feature] Evaluation Results Persistence (#1894) * feat results_station.py * lint * feat save_to_station * feat result_station.py and lint * feat * fix * fix and lint * fix * fix subjective processing * fix * fix * style function name * lint 2025-03-05 18:33:34 +08:00			`from .result_station import * # noqa`
[Feat] support opencompass 2023-07-04 22:11:33 +08:00			`from .text_postprocessors import * # noqa`