OpenCompass/configs/datasets/subjective
Alexander Lam 1bd594fc62
[Feature] Added CompassArena-SubjectiveBench with Bradley-Terry Model (#1751)
* fix lint issues

* updated gitignore

* changed infer_order from random to double for the pairwise_judge.py (not changing for pairwise_bt_judge.py

* added return statement to CompassArenaBradleyTerrySummarizer to return overall score for each judger model
2024-12-16 13:41:28 +08:00
..
alignbench [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
alpaca_eval [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
arena_hard [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
compass_arena_subjective_bench [Feature] Added CompassArena-SubjectiveBench with Bradley-Terry Model (#1751) 2024-12-16 13:41:28 +08:00
compassarena [Feature] Add OC academic 2412 (#1750) 2024-12-10 21:53:06 +08:00
compassbench [Update] Compassbench v1.3 (#1396) 2024-08-12 19:09:19 +08:00
flames [Fix] fix Flames (#1599) 2024-10-12 14:34:59 +08:00
fofo [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
followbench [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
hellobench [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
judgerbench [Update] Update Fullbench (#1712) 2024-11-26 14:26:55 +08:00
multiround [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
wildbench [Update] Update dataset configuration with no max_out_len (#1754) 2024-12-11 18:20:29 +08:00