OpenCompass/opencompass/summarizers/subjective
bittersweet1999 fa54aa62f6
[Feature] Add Judgerbench and reorg subeval (#1593)
* fix pip version

* fix pip version

* update (#1522)

Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>

* [Feature] Update Models (#1518)

* Update Models

* Update

* Update humanevalx

* Update

* Update

* [Feature] Dataset prompts update for ARC, BoolQ, Race (#1527)

add judgerbench and reorg sub

add judgerbench and reorg subeval

add judgerbench and reorg subeval

* add judgerbench and reorg subeval

* add judgerbench and reorg subeval

* add judgerbench and reorg subeval

* add judgerbench and reorg subeval

---------

Co-authored-by: zhulinJulia24 <145004780+zhulinJulia24@users.noreply.github.com>
Co-authored-by: zhulin1 <zhulin1@pjlab.org.cn>
Co-authored-by: Songyang Zhang <tonysy@users.noreply.github.com>
Co-authored-by: Linchen Xiao <xxllcc1993@gmail.com>
2024-10-15 16:36:05 +08:00
..
__init__.py [CI] add a common summarizer for qabench summarizer (#1545) 2024-09-25 13:40:47 +08:00
alignmentbench.py [Fix] add bc for alignbench summarizer (#1306) 2024-07-12 11:06:20 +08:00
all_obj.py [Fix] Fix Math Evaluation with Judge Model Evaluator & Add README (#1103) 2024-04-28 21:58:58 +08:00
alpacaeval.py [Refactor] Reorganize subjective eval (#1284) 2024-07-05 22:11:37 +08:00
arenahard.py [Refactor] Reorganize subjective eval (#1284) 2024-07-05 22:11:37 +08:00
charm.py [Feature] Update CHARM Memeorziation (#1230) 2024-07-26 18:42:30 +08:00
common_summarizer.py [CI] add a common summarizer for qabench summarizer (#1545) 2024-09-25 13:40:47 +08:00
compass_arena.py [Refactor] Reorganize subjective eval (#1284) 2024-07-05 22:11:37 +08:00
compassbench_v13.py [Update] Compassbench v1.3 (#1396) 2024-08-12 19:09:19 +08:00
compassbench.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00
corev2.py reorganize subject files (#801) 2024-01-16 18:03:11 +08:00
creationbench.py reorganize subject files (#801) 2024-01-16 18:03:11 +08:00
flames.py [Fix] fix Flames (#1599) 2024-10-12 14:34:59 +08:00
fofo.py [Refactor] Reorganize subjective eval (#1284) 2024-07-05 22:11:37 +08:00
followbench.py [Feature] add support for internal Followbench (#1511) 2024-09-11 13:32:34 +08:00
mtbench101.py [Refactor] Reorganize subjective eval (#1284) 2024-07-05 22:11:37 +08:00
mtbench.py [Refactor] Reorganize subjective eval (#1284) 2024-07-05 22:11:37 +08:00
multiround.py [Fix] Fix MultiRound Subjective Evaluation(#1043) 2024-04-22 12:06:03 +08:00
subjective_post_process.py reorganize subject files (#801) 2024-01-16 18:03:11 +08:00
subjective.py [Fix] Sub summarizer order fix (#1426) 2024-08-15 21:08:18 +08:00
utils.py [Feature] add support for internal Followbench (#1511) 2024-09-11 13:32:34 +08:00
wildbench.py [Fix] Fix wildbench (#1508) 2024-09-10 17:35:07 +08:00