OpenCompass/opencompass/utils
Lyu Han b52ba65c26
[Feature] Integrate lmdeploy pipeline api (#1198)
* integrate lmdeploy's pipeline api

* fix linting

* update user guide

* rename

* update

* update

* update

* rollback class name

* update

* remove unused code

* update

* update

* fix ci check

* compatibility

* remove concurrency

* Update configs/models/hf_internlm/lmdeploy_internlm2_chat_7b.py

* Update docs/zh_cn/advanced_guides/evaluation_lmdeploy.md

* [Bug] fix lint

---------

Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>
Co-authored-by: tonysy <sy.zhangbuaa@gmail.com>
2024-10-09 22:58:06 +08:00
..
postprocessors [Feature] Add custom model postprocess function (#1519) 2024-09-18 14:40:51 +08:00
__init__.py [Fix] Import fix (#1500) 2024-09-06 18:29:24 +08:00
abbr.py [Feature] Add multi-model judge and fix some problems (#1016) 2024-04-02 11:52:06 +08:00
auxiliary.py [Feat] support humaneval and mbpp pass@k (#598) 2023-11-16 21:22:06 +08:00
build.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
collect_env.py [Feature] Update pip install (#1324) 2024-07-29 18:32:50 +08:00
datasets_info.py [Feature] Update Models (#1518) 2024-09-12 23:35:30 +08:00
datasets.py [Feature] Add Ruler datasets (#1310) 2024-08-20 11:40:11 +08:00
dependency.py [Feature]: Use multimodal (#73) 2023-08-03 11:07:50 +08:00
file.py fix output typing, change mutable list to immutable tuple (#989) 2024-04-26 23:07:34 +08:00
fileio.py [Fix] Fix Slurm ENV (#1392) 2024-08-06 01:35:20 +08:00
lark.py [Feature] Several enhancements (#142) 2023-08-01 18:19:49 +08:00
logging.py [Enhance] Supress warning raised by get_logger (#353) 2023-09-04 15:27:08 +08:00
menu.py [Feat] Support local runner for windows (#515) 2023-10-27 17:16:22 +08:00
model_postprocessors.py [Feature] Add custom model postprocess function (#1519) 2024-09-18 14:40:51 +08:00
prompt.py Support wildbench (#1266) 2024-06-24 13:16:27 +08:00
run.py [Feature] Integrate lmdeploy pipeline api (#1198) 2024-10-09 22:58:06 +08:00
text_postprocessors.py [Feature] Fullbench v0.1 language update (#1463) 2024-08-28 14:01:05 +08:00
types.py [Sync] Initial support of subjective evaluation (#421) 2023-09-22 15:42:31 +08:00