OpenCompass/opencompass/openicl/icl_inferencer
Hubert 91fba2c2e9
[Feat] support humaneval and mbpp pass@k (#598)
* [Feat] support pass@ k

* [Feat] support pass@k

* [Feat] support pass@k

* [Feat] support pass@k

* [Feat] support pass@k

* [Feat] support pass@k docs

* update naming

---------

Co-authored-by: Leymore <zfz-960727@163.com>
2023-11-16 21:22:06 +08:00
..
__init__.py Support GSM8k evaluation with tools by Lagent and LangChain (#277) 2023-09-22 15:28:22 +08:00
icl_agent_inferencer.py [Feat] Support cibench (#538) 2023-11-07 19:11:44 +08:00
icl_attack_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00
icl_base_inferencer.py [Sync] update (#517) 2023-10-27 20:31:22 +08:00
icl_clp_inferencer.py [Refactor] Move fix_id_list to Retriever (#442) 2023-10-07 12:53:41 +08:00
icl_gen_inferencer.py [Feat] support humaneval and mbpp pass@k (#598) 2023-11-16 21:22:06 +08:00
icl_ppl_inferencer.py [Sync] update model configs (#574) 2023-11-13 15:15:34 +08:00
icl_sc_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00
icl_tot_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00