OpenCompass/opencompass/configs/datasets/subjective
Alexander Lam f871e80887
[Feature] Add Bradley-Terry Subjective Evaluation method to Arena Hard dataset (#1802)
* added base_models_abbrs to references (passed from LMEvaluator); added bradleyterry subjective evaluation method for wildbench, alpacaeval, and compassarena datasets; added all_scores output files for reference in CompassArenaBradleyTerrySummarizer;

* added bradleyterry subjective evaluation method to arena_hard dataset
2025-01-03 16:33:43 +08:00
..
alignbench [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
alpaca_eval [Feature] Added Bradley-Terry subjective evaluation 2024-12-31 11:01:23 +08:00
arena_hard [Feature] Add Bradley-Terry Subjective Evaluation method to Arena Hard dataset (#1802) 2025-01-03 16:33:43 +08:00
compass_arena_subjective_bench [Feature] Added CompassArena-SubjectiveBench with Bradley-Terry Model (#1751) 2024-12-16 13:41:28 +08:00
compassarena [Feature] Added Bradley-Terry subjective evaluation 2024-12-31 11:01:23 +08:00
compassbench [Update] Compassbench v1.3 (#1396) 2024-08-12 19:09:19 +08:00
flames [Fix] fix Flames (#1599) 2024-10-12 14:34:59 +08:00
fofo [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
followbench [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
hellobench [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
judgerbench [Update] Update Fullbench (#1712) 2024-11-26 14:26:55 +08:00
multiround [Fix] Compatible with old versions (#1616) 2024-10-21 10:16:29 +08:00
wildbench [Feature] Added Bradley-Terry subjective evaluation 2024-12-31 11:01:23 +08:00