diff --git a/docs/en/user_guides/datasets.md b/docs/en/user_guides/datasets.md index 83460672..1c34b714 100644 --- a/docs/en/user_guides/datasets.md +++ b/docs/en/user_guides/datasets.md @@ -101,7 +101,6 @@ afqmc_datasets = [ ``` -> \[!TIP\] > Additionally, for binary evaluation metrics (such as accuracy, pass-rate, etc.), you can also set the parameter `k` in conjunction with `n` for [G-Pass@k](http://arxiv.org/abs/2412.13147) evaluation. The formula for G-Pass@k is: > > ```{math} diff --git a/docs/zh_cn/user_guides/datasets.md b/docs/zh_cn/user_guides/datasets.md index d22d57f6..1c8dc616 100644 --- a/docs/zh_cn/user_guides/datasets.md +++ b/docs/zh_cn/user_guides/datasets.md @@ -100,7 +100,6 @@ afqmc_datasets = [ ] ``` -> \[!TIP\] > 另外,对于二值评测指标(例如accuracy,pass-rate等),还可以通过设置参数`k`配合`n`进行[G-Pass@k](http://arxiv.org/abs/2412.13147)评测。G-Pass@k计算公式为: > > ```{math} diff --git a/opencompass/datasets/base.py b/opencompass/datasets/base.py index 92386002..7099b0c6 100644 --- a/opencompass/datasets/base.py +++ b/opencompass/datasets/base.py @@ -1,4 +1,3 @@ -from abc import abstractstaticmethod from copy import deepcopy from typing import Dict, List, Optional, Union @@ -55,6 +54,6 @@ class BaseDataset: def test(self): return self.reader.dataset['test'] - @abstractstaticmethod + @staticmethod def load(**kwargs) -> Union[Dataset, DatasetDict]: pass