OpenCompass/opencompass/openicl/icl_inferencer
bittersweet1999 2ee8e8a1a1
[Feature] add mtbench (#829)
* add mtbench

* add mtbench

* Update configs/datasets/subjective/multiround/mtbench_judgeby_gpt4.py

Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update configs/datasets/subjective/multiround/mtbench_judgeby_gpt4.py

Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update opencompass/datasets/subjective/__init__.py

Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* Update opencompass/datasets/subjective/mtbench.py

Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>

* fix mtbench

---------

Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>
2024-01-24 12:11:47 +08:00
..
__init__.py [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00
icl_agent_inferencer.py [Sync] minor test (#683) 2023-12-11 17:42:53 +08:00
icl_attack_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00
icl_base_inferencer.py [Sync] update (#517) 2023-10-27 20:31:22 +08:00
icl_chat_inferencer.py [Feature] add mtbench (#829) 2024-01-24 12:11:47 +08:00
icl_clp_inferencer.py [Refactor] Move fix_id_list to Retriever (#442) 2023-10-07 12:53:41 +08:00
icl_gen_inferencer.py [Sync] Add InternLM2 Keyset Evaluation Demo (#807) 2024-01-17 13:48:12 +08:00
icl_ll_inferencer.py [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00
icl_mink_percent_inferencer.py [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00
icl_ppl_inferencer.py [Sync] update model configs (#574) 2023-11-13 15:15:34 +08:00
icl_ppl_only_inferencer.py [Sync] minor test (#683) 2023-12-11 17:42:53 +08:00
icl_sc_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00
icl_tot_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00