mirror of
https://github.com/open-compass/opencompass.git
synced 2025-05-30 16:03:24 +08:00
del [TIP]
This commit is contained in:
parent
46cd631e13
commit
97594676e8
@ -101,7 +101,6 @@ afqmc_datasets = [
|
||||
|
||||
```
|
||||
|
||||
> \[!TIP\]
|
||||
> Additionally, for binary evaluation metrics (such as accuracy, pass-rate, etc.), you can also set the parameter `k` in conjunction with `n` for [G-Pass@k](http://arxiv.org/abs/2412.13147) evaluation. The formula for G-Pass@k is:
|
||||
>
|
||||
> ```{math}
|
||||
|
@ -100,7 +100,6 @@ afqmc_datasets = [
|
||||
]
|
||||
```
|
||||
|
||||
> \[!TIP\]
|
||||
> 另外,对于二值评测指标(例如accuracy,pass-rate等),还可以通过设置参数`k`配合`n`进行[G-Pass@k](http://arxiv.org/abs/2412.13147)评测。G-Pass@k计算公式为:
|
||||
>
|
||||
> ```{math}
|
||||
|
@ -1,4 +1,3 @@
|
||||
from abc import abstractstaticmethod
|
||||
from copy import deepcopy
|
||||
from typing import Dict, List, Optional, Union
|
||||
|
||||
@ -55,6 +54,6 @@ class BaseDataset:
|
||||
def test(self):
|
||||
return self.reader.dataset['test']
|
||||
|
||||
@abstractstaticmethod
|
||||
@staticmethod
|
||||
def load(**kwargs) -> Union[Dataset, DatasetDict]:
|
||||
pass
|
||||
|
Loading…
Reference in New Issue
Block a user