Alexander Lam f871e80887 [Feature] Add Bradley-Terry Subjective Evaluation method to Arena Hard dataset (#1802) ... * added base_models_abbrs to references (passed from LMEvaluator); added bradleyterry subjective evaluation method for wildbench, alpacaeval, and compassarena datasets; added all_scores output files for reference in CompassArenaBradleyTerrySummarizer; * added bradleyterry subjective evaluation method to arena_hard dataset		2025-01-03 16:33:43 +08:00
..
cli	[Feature] Support import configs/models/summarizers from whl (#1376)	2024-08-01 00:42:48 +08:00
configs	[Feature] Add Bradley-Terry Subjective Evaluation method to Arena Hard dataset (#1802)	2025-01-03 16:33:43 +08:00
datasets	[Feature] Add Bradley-Terry Subjective Evaluation method to Arena Hard dataset (#1802)	2025-01-03 16:33:43 +08:00
evaluator	[Fix] Fix generic_llm_evaluator output_path (#1798)	2024-12-31 13:05:05 +08:00
lagent	Update CIBench (#1089)	2024-04-26 18:46:02 +08:00
metrics	[Feat] Support multi-modal evaluation on MME benchmark. (#197)	2023-08-21 15:53:20 +08:00
models	[Feature] Add Longbenchv2 support (#1801)	2025-01-03 12:04:29 +08:00
openicl	[Feature] Added Bradley-Terry subjective evaluation	2024-12-31 11:01:23 +08:00
partitioners	[Fix] fix duplicate error in partitioner (#1552)	2024-09-23 19:45:21 +08:00
runners	[Update] Volc status exception handle (#1780)	2024-12-26 15:43:24 +08:00
summarizers	[Feature] Added Bradley-Terry subjective evaluation	2024-12-31 11:01:23 +08:00
tasks	[Fix] Fix generic_llm_evaluator output_path (#1798)	2024-12-31 13:05:05 +08:00
utils	[Feature] Add Longbenchv2 support (#1801)	2025-01-03 12:04:29 +08:00
__init__.py	[BUMP] Bump version to 0.3.9 (#1790)	2024-12-31 16:52:47 +08:00
registry.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00