OpenCompass/opencompass
bittersweet1999 fa54aa62f6
[Feature] Add Judgerbench and reorg subeval (#1593)
* fix pip version

* fix pip version

* update (#1522)

Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>

* [Feature] Update Models (#1518)

* Update Models

* Update

* Update humanevalx

* Update

* Update

* [Feature] Dataset prompts update for ARC, BoolQ, Race (#1527)

add judgerbench and reorg sub

add judgerbench and reorg subeval

add judgerbench and reorg subeval

* add judgerbench and reorg subeval

* add judgerbench and reorg subeval

* add judgerbench and reorg subeval

* add judgerbench and reorg subeval

---------

Co-authored-by: zhulinJulia24 <145004780+zhulinJulia24@users.noreply.github.com>
Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>
Co-authored-by: Linchen Xiao <xxllcc1993@gmail.com>
2024-10-15 16:36:05 +08:00
..
cli [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
configs [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00
datasets [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Fix] fix interntrain's tokenizer truncate (#1605) 2024-10-15 16:03:57 +08:00
openicl [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00
partitioners [Fix] fix duplicate error in partitioner (#1552) 2024-09-23 19:45:21 +08:00
runners [Fix] Update dlc runner python env (#1604) 2024-10-14 15:50:21 +08:00
summarizers [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00
tasks [Feature] Add model postprocess function (#1484) 2024-09-05 21:10:29 +08:00
utils [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00
__init__.py [BUMP] Bump version to 0.3.3 (#1581) 2024-09-30 16:57:41 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00