OpenCompass/configs/datasets/ruler/ruler_combined_gen.py
Chang Lan a927bba1cf
[Fix] Fix RULER datasets (#1628)
We need to ensure that we don't import anything that ends with "_datasets",
or they will be picked up by the runner, leading to duplicate / unwanted datasets
being evaluated.
2024-10-22 11:59:02 +08:00

12 lines
515 B
Python

from mmengine.config import read_base
with read_base():
from .ruler_1m_gen import ruler_datasets as ruler_1m_ds
from .ruler_4k_gen import ruler_datasets as ruler_4k_ds
from .ruler_8k_gen import ruler_datasets as ruler_8k_ds
from .ruler_16k_gen import ruler_datasets as ruler_16k_ds
from .ruler_32k_gen import ruler_datasets as ruler_32k_ds
from .ruler_128k_gen import ruler_datasets as ruler_128k_ds
ruler_combined_datasets = sum((v for k, v in locals().items() if k.endswith('_ds')), [])