OpenCompass/opencompass/configs/summarizers/groups/musr_average.py
abrohamLee e9e4b69ddb
[Feature] MuSR Datset Evaluation (#1689)
* MuSR Datset Evaluation

* MuSR Datset Evaluation

Add an assertion and a Readme.md
2024-11-14 20:42:12 +08:00

19 lines
418 B
Python

summarizer = dict(
dataset_abbrs=[
'musr_murder_mysteries',
'musr_object_placements',
'musr_team_allocation',
'musr_average'
],
summary_groups=[
{
'name': 'musr_average',
'subsets': [
'musr_murder_mysteries',
'musr_object_placements',
'musr_team_allocation',
],
}
],
)