jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
626 Commits 11 Branches 35 Tags 66 MiB
818d72a650
Commit Graph

40 Commits

Author SHA1 Message Date
Songyang Zhang
c81329b548
[Fix] Fix Slurm ENV (#1392) 
1. Support Slurm Cluster
2. Support automatic data download
3. Update InternLM2.5-1.8B/20B-Chat
 2024-08-06 01:35:20 +08:00
Songyang Zhang
46cc7894e1
[Feature] Support import configs/models/summarizers from whl (#1376) 
* [Feature] Support import configs/models/summarizers from whl

* Update LCBench configs

* Update

* Update

* Update

* Update

* update

* Update

* Update

* Update

* Update

* Update
 2024-08-01 00:42:48 +08:00
LeavittLang
8ee7fecb68
Adding support for Doubao API (#1218) 
* Adding support for Doubao API

* Update doubao_api.py

Fixed the bug that the connection would be retried even if it was normal.

* Update doubao_api.py

---------

Co-authored-by: bittersweet1999 <148421775+bittersweet1999@users.noreply.github.com>
 2024-07-26 11:44:51 +08:00
Fengzhe Zhou
a32f21a356
[Sync] Sync with internal codes 2024.06.28 (#1279) 2024-06-28 14:16:34 +08:00
LIU Xiao
83b9fd9eaa
add ",<2.0.0" to "numpy>=1.23.4" in requirements/runtime.txt, as pandas<2.0.0 doesn't compatible with numpy>=2.0.0 (#1267) 2024-06-24 11:03:42 +08:00
bittersweet1999
e0d7808b4e
[Fix] fix pip version (#1228) 
* fix pip version

* fix pip version
 2024-06-06 11:48:07 +08:00
Fengzhe Zhou
2954913d9b
[Sync] bump version (#1204) 2024-05-28 23:09:59 +08:00
klein
e4830a6926
Update CIBench (#1089) 
* modify the requirements/runtime.txt: numpy==1.23.4 --> numpy>=1.23.4

* update cibench: dataset and evluation

* cibench summarizer bug

* update cibench

* move extract_code import

---------

Co-authored-by: zhangchuyu@pjlab.org.cn <zhangchuyu@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>
 2024-04-26 18:46:02 +08:00
Fengzhe Zhou
b39f501563
[Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00
bittersweet1999
02e7eec911
[Feature] Support AlpacaEval_V2 (#1006) 
* support alpacaeval_v2

* support alpacaeval

* update docs

* update docs
 2024-03-28 16:49:04 +08:00
klein
4d2591acb2
modify the requirements/runtime.txt: numpy==1.23.4 --> numpy>=1.23.4 (#983) 
Co-authored-by: zhangchuyu@pjlab.org.cn <zhangchuyu@pjlab.org.cn>
 2024-03-18 20:25:55 +08:00
bittersweet1999
45c606bcd0
[Fix] Fix IFEval (#906) 
* fix ifeval

* fix ifeval

* fix ifeval

* fix ifeval
 2024-02-22 16:51:34 +08:00
Guo Qipeng
4f78388c71
Update runtime.txt to fix rouge_chinese bugs. (#803) 
* Update runtime.txt to fix rouge_chinese bugs.

the wheel file of rouge_chinese will overwrite the rouge package, causing bugs. Replacing it to the github code, which is the correct version.

* fix PEP format issues

* fix PEP format issues

* enable pip install

---------

Co-authored-by: 郭琦鹏 <guoqipeng@pjlab.org.cn>
Co-authored-by: Leymore <zfz-960727@163.com>
 2024-01-29 19:18:22 +08:00
Hubert
4aa74565e2
[Feat] minor update agent related (#839) 
* [Feat] update cibench

* [Feat] Support CIBench

* [Feat] Support CIBench

* [Feat] Support CIBench

* [Feat] Support CIBench
 2024-01-26 14:15:51 +08:00
Songyang Zhang
793e32c9cc
[Feature] Update API implementation (#834) 2024-01-24 13:35:21 +08:00
Hubert
d0dc3534e5
[Fix] hot fix for requirements (#789) 2024-01-11 15:48:32 +08:00
Fengzhe Zhou
32f40a8f83
[Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00
Hubert
e78857ac36
[Sync] minor test (#683) 2023-12-11 17:42:53 +08:00
Hubert
1029119e39
[Feat] support pr merge test ci (#669) 
* [Feat] support ci

* [Feat] support ci

* [Feat] support ci

* [Feat] support ci

* init docs

* init docs

* init docs
 2023-12-11 14:12:04 +08:00
bittersweet1999
1c95790fdd
New subjective judgement (#660) 
* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* add new subjective judgement

* modified to a more general way

* modified to a more general way

* final

* final

* add summarizer

* add new summarize

* fixed

* fixed

* fixed

---------

Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>
 2023-12-06 13:28:33 +08:00
Hubert
e9e75fb4eb
[Fix] remove colossalai dependency (#645) 2023-11-28 14:09:44 +08:00
Songyang Zhang
5329724b65
[Doc] Update README and requirements. (#622) 
* update readme

* update doc
 2023-11-22 19:16:54 +08:00
Songyang Zhang
d925748266
[Feature] Support 360API and FixKRetriever for CSQA dataset (#601) 
* [Feature] Support 360API and FixKRetriever for CSQA dataset

* Update API

* Update API

* [Feature] Support 360API and FixKRetriever for CSQA dataset

* Update API

* Update API

* rm mathbench

* fix_lint

* Update opencompass/models/bytedance_api.py

Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>

* update

* update

* update

---------

Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>
 2023-11-21 20:25:47 +08:00
Yuan Feng
7199acc25d
Add support for DataCanvas Alaya LM (#612) 
* Support for Alaya

* Remove useless requirements
 2023-11-21 17:51:30 +08:00
Songyang Zhang
32884f2e39
[Feature] Update api.txt (#567) 2023-11-10 15:55:23 +08:00
Hubert
cf5a6d1ab7
[Fix] fix unnecessary import and update requirements (#555) 2023-11-08 17:58:49 +08:00
Songyang Zhang
239c2a346e
[Feature] Add support for MiniMax API (#548) 
* update requirement

* update requirement

* update with minimax

* update api model

* Update readme

* fix error

---------

Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
 2023-11-06 21:57:32 +08:00
Qing
e2355a2ede
[Feature] Add multi model viz (#509) 
* add viz_multi_model.py tool

* Modify the viz_multi_model.py script according to the review

* highlight multiple optimal scores

---------

Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
Co-authored-by: Leymore <zfz-960727@163.com>
 2023-10-30 12:11:33 +08:00
Fengzhe Zhou
dbb20b8270
[Sync] update (#517) 2023-10-27 20:31:22 +08:00
Leymore
861942ab1b
[Feature] Add lawbench (#460) 
* add lawbench

* update requirements

* update
 2023-10-13 06:51:36 -05:00
Leymore
fbf5089c40
[Sync] update github token (#475) 2023-10-13 06:50:54 -05:00
Leymore
d7ff933a73
[Fix] Use jieba rouge in lcsts (#459) 
* use jieba rouge in lcsts

* use rouge_chinese
 2023-10-09 10:10:33 +08:00
Tong Gao
767c12a660
[Docs] update get_started (#435) 
* [Docs] update get_started

* [Docs] Refactor get_started

* update

* add zh FAQ

* add cn doc

* update

* fix dead links

---------

Co-authored-by: Leymore <zfz-960727@163.com>
 2023-10-07 11:49:40 +08:00
Tong Gao
2a271dbf60
[Docs] Update doc theme (#332) 
* [Docs] Update doc theme

* update
 2023-08-31 10:44:21 +08:00
philipwangOvO
655a807f4b
[Dataset] LongBench (#236) 
Co-authored-by: wangchonghua <wangchonghua@pjlab.org.cn>
 2023-08-21 14:15:20 +08:00
Tong Gao
c6a3494993
[Fix] requirements (#229) 2023-08-18 14:34:20 +08:00
dependabot[bot]
0555d59a6a
Bump requests from 2.28.1 to 2.31.0 (#178) 
Bumps [requests](https://github.com/psf/requests) from 2.28.1 to 2.31.0.
- [Release notes](https://github.com/psf/requests/releases)
- [Changelog](https://github.com/psf/requests/blob/main/HISTORY.md)
- [Commits](https://github.com/psf/requests/compare/v2.28.1...v2.31.0)

---
updated-dependencies:
- dependency-name: requests
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-09 19:41:09 +08:00
Tong Gao
1e44541730
[Enhancement] Test linting in CI and fix existing linting errors (#69) 
* [Enhancement] Test linting in CI

* fix linting
 2023-07-17 15:59:10 +08:00
tonysy
e6b5bdcb87 OpenCompass Public MR 2023-07-05 03:15:21 +00:00
gaotongxiao
7d346000bb initial commit 2023-07-04 21:34:55 +08:00