OpenCompass/opencompass/openicl/icl_inferencer
Hari Seldon 14b4b735cb
[Feature] Add support for SciCode (#1417)
* add SciCode

* add SciCode

* add SciCode

* add SciCode

* add SciCode

* add SciCode

* add SciCode

* add SciCode w/ bg

* add scicode

* Update README.md

* Update README.md

* Delete configs/eval_SciCode.py

* rename

* 1

* rename

* Update README.md

* Update scicode.py

* Update scicode.py

* fix some bugs

* Update

* Update

---------

Co-authored-by: root <HariSeldon0>
Co-authored-by: tonysy <sy.zhangbuaa@gmail.com>
2024-08-22 13:42:25 +08:00
..
__init__.py [Feature] Support inference ppl datasets (#1315) 2024-07-22 17:59:30 +08:00
icl_agent_inferencer.py [Feat] minor update agent related (#839) 2024-01-26 14:15:51 +08:00
icl_attack_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00
icl_base_inferencer.py [Sync] bump version (#1204) 2024-05-28 23:09:59 +08:00
icl_chat_inferencer.py [Feature] Add support for SciCode (#1417) 2024-08-22 13:42:25 +08:00
icl_clp_inferencer.py [Refactor] Move fix_id_list to Retriever (#442) 2023-10-07 12:53:41 +08:00
icl_gen_inferencer.py [Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
icl_inference_ppl_only_inferencer.py [Feature] Support inference ppl datasets (#1315) 2024-07-22 17:59:30 +08:00
icl_ll_inferencer.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
icl_mink_percent_inferencer.py [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00
icl_ppl_inferencer.py [Feature] Add huggingface apply_chat_template (#1098) 2024-05-14 14:50:16 +08:00
icl_ppl_only_inferencer.py [Sync] minor test (#683) 2023-12-11 17:42:53 +08:00
icl_sc_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00
icl_sw_ce_loss_inferencer.py [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
icl_tot_inferencer.py [Fix] change save_every defaults to 1 (#592) 2023-11-15 13:00:25 +08:00