3 Commits

Author	SHA1	Message	Date
Alexander Lam	7f2aeeff26	added predicted win rates reporting to bradley terry subj eval methods with an option to switch between win rates and elo ratings (#1815)	2025-01-10 18:20:25 +08:00
Alexander Lam	f871e80887	[Feature] Add Bradley-Terry Subjective Evaluation method to Arena Hard dataset (#1802) ... * added base_models_abbrs to references (passed from LMEvaluator); added bradleyterry subjective evaluation method for wildbench, alpacaeval, and compassarena datasets; added all_scores output files for reference in CompassArenaBradleyTerrySummarizer; * added bradleyterry subjective evaluation method to arena_hard dataset	2025-01-03 16:33:43 +08:00
Alexander Lam	dc6035cfcb	[Feature] Added Bradley-Terry subjective evaluation	2024-12-31 11:01:23 +08:00