4 Commits

Author	SHA1	Message	Date
Linchen Xiao	408f5caff4	[Dataset] Add SuperGPQA subfield configs (#2124) ... * update * fix lint * fix lint * update precommit * update precommit * fix lint	2025-05-28 14:12:58 +08:00
Alexander Lam	7f2aeeff26	added predicted win rates reporting to bradley terry subj eval methods with an option to switch between win rates and elo ratings (#1815)	2025-01-10 18:20:25 +08:00
Alexander Lam	dc6035cfcb	[Feature] Added Bradley-Terry subjective evaluation	2024-12-31 11:01:23 +08:00
Alexander Lam	1bd594fc62	[Feature] Added CompassArena-SubjectiveBench with Bradley-Terry Model (#1751) ... * fix lint issues * updated gitignore * changed infer_order from random to double for the pairwise_judge.py (not changing for pairwise_bt_judge.py * added return statement to CompassArenaBradleyTerrySummarizer to return overall score for each judger model	2024-12-16 13:41:28 +08:00