2023-07-05 10:22:40 +08:00
|
|
|
exclude: |
|
|
|
|
(?x)^(
|
|
|
|
tests/data/|
|
[Feature] Support ModelScope datasets (#1289)
* add ceval, gsm8k modelscope surpport
* update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest
* update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets
* format file
* format file
* update dataset format
* support ms_dataset
* udpate dataset for modelscope support
* merge myl_dev and update test_ms_dataset
* udpate dataset for modelscope support
* update readme
* update eval_api_zhipu_v2
* remove unused code
* add get_data_path function
* update readme
* remove tydiqa japanese subset
* add ceval, gsm8k modelscope surpport
* update race, mmlu, arc, cmmlu, commonsenseqa, humaneval and unittest
* update bbh, flores, obqa, siqa, storycloze, summedits, winogrande, xsum datasets
* format file
* format file
* update dataset format
* support ms_dataset
* udpate dataset for modelscope support
* merge myl_dev and update test_ms_dataset
* update readme
* udpate dataset for modelscope support
* update eval_api_zhipu_v2
* remove unused code
* add get_data_path function
* remove tydiqa japanese subset
* update util
* remove .DS_Store
* fix md format
* move util into package
* update docs/get_started.md
* restore eval_api_zhipu_v2.py, add environment setting
* Update dataset
* Update
* Update
* Update
* Update
---------
Co-authored-by: Yun lin <yunlin@U-Q9X2K4QV-1904.local>
Co-authored-by: Yunnglin <mao.looper@qq.com>
Co-authored-by: Yun lin <yunlin@laptop.local>
Co-authored-by: Yunnglin <maoyl@smail.nju.edu.cn>
Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
2024-07-29 13:48:32 +08:00
|
|
|
tests/dataset/|
|
2023-07-05 10:22:40 +08:00
|
|
|
opencompass/models/internal/|
|
2023-09-20 16:35:22 +08:00
|
|
|
opencompass/utils/internal/|
|
2023-10-13 19:51:36 +08:00
|
|
|
opencompass/openicl/icl_evaluator/hf_metrics/|
|
|
|
|
opencompass/datasets/lawbench/utils|
|
2023-12-09 16:05:46 +08:00
|
|
|
opencompass/datasets/lawbench/evaluation_functions/|
|
2024-01-05 20:39:36 +08:00
|
|
|
opencompass/datasets/medbench/|
|
2024-02-05 23:29:10 +08:00
|
|
|
opencompass/datasets/teval/|
|
2024-02-05 15:52:28 +08:00
|
|
|
opencompass/datasets/NPHardEval/|
|
2024-04-22 15:22:04 +08:00
|
|
|
opencompass/datasets/TheoremQA|
|
2024-06-03 14:52:12 +08:00
|
|
|
opencompass/datasets/subjective/mtbench101.py|
|
2024-07-19 23:12:23 +08:00
|
|
|
docs/zh_cn/advanced_guides/compassbench_intro.md |
|
2024-08-01 00:42:48 +08:00
|
|
|
docs/zh_cn/advanced_guides/compassbench_v2_0.md |
|
2024-08-06 01:35:20 +08:00
|
|
|
opencompass/utils/datasets.py |
|
|
|
|
opencompass/utils/datasets_info.py
|
2023-07-05 10:22:40 +08:00
|
|
|
)
|
|
|
|
repos:
|
|
|
|
- repo: https://github.com/PyCQA/flake8
|
|
|
|
rev: 5.0.4
|
|
|
|
hooks:
|
|
|
|
- id: flake8
|
2024-08-22 14:48:45 +08:00
|
|
|
exclude: |
|
|
|
|
(?x)^(
|
2025-01-20 19:17:38 +08:00
|
|
|
opencompass/configs/|
|
|
|
|
examples/
|
2024-08-22 14:48:45 +08:00
|
|
|
)
|
2023-07-05 10:22:40 +08:00
|
|
|
- repo: https://github.com/PyCQA/isort
|
|
|
|
rev: 5.11.5
|
|
|
|
hooks:
|
|
|
|
- id: isort
|
2024-08-22 14:48:45 +08:00
|
|
|
exclude: |
|
|
|
|
(?x)^(
|
2025-01-20 19:17:38 +08:00
|
|
|
opencompass/configs/|
|
|
|
|
examples/
|
2024-08-22 14:48:45 +08:00
|
|
|
)
|
2023-07-05 10:22:40 +08:00
|
|
|
- repo: https://github.com/pre-commit/mirrors-yapf
|
|
|
|
rev: v0.32.0
|
|
|
|
hooks:
|
|
|
|
- id: yapf
|
2024-08-22 14:48:45 +08:00
|
|
|
exclude: |
|
|
|
|
(?x)^(
|
2025-01-20 19:17:38 +08:00
|
|
|
opencompass/configs/|
|
|
|
|
examples/
|
2024-08-22 14:48:45 +08:00
|
|
|
)
|
2023-07-05 10:22:40 +08:00
|
|
|
- repo: https://github.com/codespell-project/codespell
|
|
|
|
rev: v2.2.1
|
|
|
|
hooks:
|
|
|
|
- id: codespell
|
2023-08-28 17:35:04 +08:00
|
|
|
exclude: |
|
2023-08-25 11:46:23 +08:00
|
|
|
(?x)^(
|
2023-08-28 17:35:04 +08:00
|
|
|
.*\.jsonl|
|
2024-05-28 23:09:59 +08:00
|
|
|
.*\.md.template|
|
2024-08-22 14:48:45 +08:00
|
|
|
opencompass/configs/ |
|
2025-01-20 19:17:38 +08:00
|
|
|
examples/
|
2023-08-28 17:35:04 +08:00
|
|
|
)
|
2023-07-05 10:22:40 +08:00
|
|
|
- repo: https://github.com/pre-commit/pre-commit-hooks
|
|
|
|
rev: v4.3.0
|
|
|
|
hooks:
|
|
|
|
- id: trailing-whitespace
|
|
|
|
exclude: |
|
|
|
|
(?x)^(
|
|
|
|
dicts/|
|
2023-08-28 17:35:04 +08:00
|
|
|
projects/.*?/dicts/|
|
2023-07-05 10:22:40 +08:00
|
|
|
)
|
|
|
|
- id: check-yaml
|
|
|
|
- id: end-of-file-fixer
|
|
|
|
exclude: |
|
|
|
|
(?x)^(
|
|
|
|
dicts/|
|
2023-08-28 17:35:04 +08:00
|
|
|
projects/.*?/dicts/|
|
2023-07-05 10:22:40 +08:00
|
|
|
)
|
|
|
|
- id: requirements-txt-fixer
|
|
|
|
- id: double-quote-string-fixer
|
|
|
|
- id: check-merge-conflict
|
|
|
|
- id: fix-encoding-pragma
|
|
|
|
args: ["--remove"]
|
|
|
|
- id: mixed-line-ending
|
|
|
|
args: ["--fix=lf"]
|
|
|
|
- repo: https://github.com/executablebooks/mdformat
|
|
|
|
rev: 0.7.9
|
|
|
|
hooks:
|
|
|
|
- id: mdformat
|
|
|
|
args: ["--number", "--table-width", "200"]
|
|
|
|
additional_dependencies:
|
|
|
|
- mdformat-openmmlab
|
|
|
|
- mdformat_frontmatter
|
|
|
|
- linkify-it-py
|
2023-08-28 17:35:04 +08:00
|
|
|
exclude: configs/
|
2023-07-05 10:22:40 +08:00
|
|
|
- repo: https://github.com/myint/docformatter
|
|
|
|
rev: v1.3.1
|
|
|
|
hooks:
|
|
|
|
- id: docformatter
|
|
|
|
args: ["--in-place", "--wrap-descriptions", "79"]
|
2023-08-28 17:35:04 +08:00
|
|
|
- repo: local
|
|
|
|
hooks:
|
|
|
|
- id: update-dataset-suffix
|
|
|
|
name: dataset suffix updater
|
|
|
|
entry: ./tools/update_dataset_suffix.py
|
|
|
|
language: script
|
|
|
|
pass_filenames: true
|
|
|
|
require_serial: true
|
2025-01-20 19:17:38 +08:00
|
|
|
files: ^opencompass/configs/datasets
|
2024-08-01 00:42:48 +08:00
|
|
|
- repo: local
|
|
|
|
hooks:
|
2024-08-01 19:10:13 +08:00
|
|
|
- id: update-dataset-suffix-pacakge
|
2024-08-01 00:42:48 +08:00
|
|
|
name: dataset suffix updater(package)
|
|
|
|
entry: ./tools/update_dataset_suffix.py
|
|
|
|
language: script
|
2024-08-16 15:54:07 +08:00
|
|
|
pass_filenames: false
|
|
|
|
# require_serial: true
|
|
|
|
# files: ^opencompass/configs/datasets
|
2024-08-01 00:42:48 +08:00
|
|
|
args:
|
|
|
|
- --root_folder
|
|
|
|
- opencompass/configs/datasets
|
2023-07-05 10:22:40 +08:00
|
|
|
# - repo: https://github.com/open-mmlab/pre-commit-hooks
|
|
|
|
# rev: v0.2.0 # Use the ref you want to point at
|
|
|
|
# hooks:
|
|
|
|
# - id: check-algo-readme
|
|
|
|
# - id: check-copyright
|
|
|
|
# args: ["mmocr", "tests", "tools"] # these directories will be checked
|