[Doc] Update README (#1404)

* [Doc] Update README

* Update
This commit is contained in:
Songyang Zhang 2024-08-08 16:18:33 +08:00 committed by GitHub
parent decb621ff6
commit 88eb91219b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
3 changed files with 23 additions and 3 deletions

View File

@ -138,6 +138,10 @@ pip install -e .
### 📂 Data Preparation ### 📂 Data Preparation
You can choose one for the following method to prepare datasets.
#### Offline Preparation
You can download and extract the datasets with the following commands: You can download and extract the datasets with the following commands:
```bash ```bash
@ -146,12 +150,19 @@ wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/Ope
unzip OpenCompassData-core-20240207.zip unzip OpenCompassData-core-20240207.zip
``` ```
Also, use the [ModelScope](www.modelscope.cn) to load the datasets on demand. #### Automatic Download from OpenCompass
We have supported download datasets automatic from the OpenCompass storage server. You can run the evaluation with extra `--dry-run` to download these datasets.
Currently, the supported datasets are listed in [here](https://github.com/open-compass/opencompass/blob/main/opencompass/utils/datasets_info.py#L259). More datasets will be uploaded recently.
#### (Optional) Automatic Download with ModelScope
Also you can use the [ModelScope](www.modelscope.cn) to load the datasets on demand.
Installation: Installation:
```bash ```bash
pip install modelscope pip install modelscope[framework]
export DATASET_SOURCE=ModelScope export DATASET_SOURCE=ModelScope
``` ```

View File

@ -140,6 +140,8 @@ pip install -e .
### 📂 数据准备 ### 📂 数据准备
#### 提前离线下载
OpenCompass支持使用本地数据集进行评测数据集的下载和解压可以通过以下命令完成 OpenCompass支持使用本地数据集进行评测数据集的下载和解压可以通过以下命令完成
```bash ```bash
@ -148,6 +150,13 @@ wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/Ope
unzip OpenCompassData-core-20240207.zip unzip OpenCompassData-core-20240207.zip
``` ```
#### 从 OpenCompass 自动下载
我们已经支持从OpenCompass存储服务器自动下载数据集。您可以通过额外的 `--dry-run` 参数来运行评估以下载这些数据集。
目前支持的数据集列表在[这里](https://github.com/open-compass/opencompass/blob/main/opencompass/utils/datasets_info.py#L259)。更多数据集将会很快上传。
#### (可选) 使用 ModelScope 自动下载
另外,您还可以使用[ModelScope](www.modelscope.cn)来加载数据集: 另外,您还可以使用[ModelScope](www.modelscope.cn)来加载数据集:
环境准备: 环境准备:

View File

@ -222,7 +222,7 @@ class VOLCRunner(BaseRunner):
f.write(logs) f.write(logs)
if task_status in [ if task_status in [
'Success', 'Failed', 'Cancelled', 'Exception', 'Success', 'Failed', 'Cancelled', 'Exception',
'Killing' 'Killing', 'SuccessHolding', 'FailedHolding'
]: ]:
break break
time.sleep(poll_interval) time.sleep(poll_interval)