OpenCompass/opencompass
2025-01-22 11:41:46 +08:00
..
cli [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
configs [Refactor] Code refactoarization (#1831) 2025-01-20 19:17:38 +08:00
datasets [Feature] Support MMLU-CF Benchmark (#1775) 2025-01-09 14:11:20 +08:00
evaluator [Update] Update o1 eval prompt (#1806) 2025-01-07 00:14:32 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Fix] Update max_out_len logic for OpenAI model (#1839) 2025-01-21 15:46:14 +08:00
openicl [Feature] Added Bradley-Terry subjective evaluation 2024-12-31 11:01:23 +08:00
partitioners [Fix] fix duplicate error in partitioner (#1552) 2024-09-23 19:45:21 +08:00
runners [Update] Volc status exception handle (#1780) 2024-12-26 15:43:24 +08:00
summarizers added predicted win rates reporting to bradley terry subj eval methods with an option to switch between win rates and elo ratings (#1815) 2025-01-10 18:20:25 +08:00
tasks [Fix] Fix generic_llm_evaluator output_path (#1798) 2024-12-31 13:05:05 +08:00
utils [Update] Update o1 eval prompt (#1806) 2025-01-07 00:14:32 +08:00
__init__.py [Bump] Bump version to 0.4.0 (#1838) 2025-01-22 11:41:46 +08:00
registry.py [Feature] Add Judgerbench and reorg subeval (#1593) 2024-10-15 16:36:05 +08:00