OpenCompass/opencompass/openicl
bittersweet1999 fa54aa62f6
[Feature] Add Judgerbench and reorg subeval (#1593)
* fix pip version

* fix pip version

* update (#1522)

Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>

* [Feature] Update Models (#1518)

* Update Models

* Update

* Update humanevalx

* Update

* Update

* [Feature] Dataset prompts update for ARC, BoolQ, Race (#1527)

add judgerbench and reorg sub

add judgerbench and reorg subeval

add judgerbench and reorg subeval

* add judgerbench and reorg subeval

* add judgerbench and reorg subeval

* add judgerbench and reorg subeval

* add judgerbench and reorg subeval

---------

Co-authored-by: zhulinJulia24 <145004780+zhulinJulia24@users.noreply.github.com>
Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>
Co-authored-by: Linchen Xiao <xxllcc1993@gmail.com>
2024-10-15 16:36:05 +08:00
..
icl_evaluator [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00
icl_inferencer [Feature] Support verbose for OpenAI API (#1546) 2024-09-20 17:12:52 +08:00
icl_retriever [Feature] Fullbench v0.1 language update (#1463) 2024-08-28 14:01:05 +08:00
utils [Enhancement] Test linting in CI and fix existing linting errors (#69) 2023-07-17 15:59:10 +08:00
__init__.py [Enhancement] Test linting in CI and fix existing linting errors (#69) 2023-07-17 15:59:10 +08:00
icl_dataset_reader.py [Sync] Initial support of subjective evaluation (#421) 2023-09-22 15:42:31 +08:00
icl_prompt_template.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00