jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
605 Commits 11 Branches 35 Tags 66 MiB
51a94aee01
Commit Graph

384 Commits

Author SHA1 Message Date
gowithme
57fcfc975a
[Feature] Support intern lanuage model (#51) 
* support internLM

* support internLM

* simplify intern model files

* update storage_manager

* support internLM

* Modify the file organization structure

* support internLM

* support internLM

* support internLM

* support internLM

* change some details
 2023-07-27 18:49:36 +08:00
Hubert
b7184e9db5
[Refactor] Update crows-pairs evaluation (#98) 
* [Refactor] Update crows-pairs evaluation

* [Refactor] Update crows-pairs evaluation

* minor
 2023-07-26 11:21:32 +08:00
Haonan Li
e9cdb24ddd
[Feature] Add CMMLU dataset (#91) 
* add CMMLU

* debug cmmlu

* add slurm args `qos`

* fix format: space before comment

* remove unused variable

* change the location of `answer is`

---------

Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>
 2023-07-25 10:14:27 +08:00
Haodong Duan
6e885d668b
force utf-8 encoding for all non-dataset fileios (#97) 2023-07-25 10:06:01 +08:00
Leymore
3fe5ee096c
[Feature] Add heuristic size partitioner (#63) 
* [Feature] Add heuristic size partitioner

* update
 2023-07-20 11:53:24 +08:00
Leymore
eea8b04417
[Feature] Add llama-2 models (#81) 
* add llama-2 models

* update docs

---------

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
 2023-07-19 19:51:29 +08:00
Hubert
f83e125e5a
[Feat] Support CValues Responsibility dataset (#78) 
* [Feat] support CValues

* minor fix
 2023-07-18 18:45:15 +08:00
LZH
26e2f171f4
[Feature] Support load PEFT adapter for HuggingFace model (#74) 
* support peft for HuggingFace model

* add docstring
 2023-07-18 16:21:43 +08:00
liushz
f36c0496f3
[Feature] Add tydiqa-goldp (#75) 
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
 2023-07-18 14:54:35 +08:00
Tong Gao
311bf0daa7
[Fix] Fix CI (#70) 
* [Fix] Fix CI

* [Fix] Fix CI

* [Fix] Fix CI

* update
 2023-07-17 19:10:59 +08:00
Tong Gao
29006e39c0
[Fix] Fix circular import of PromptTemplate (#71) 2023-07-17 19:09:38 +08:00
Tong Gao
1e44541730
[Enhancement] Test linting in CI and fix existing linting errors (#69) 
* [Enhancement] Test linting in CI

* fix linting
 2023-07-17 15:59:10 +08:00
Leymore
1326aff77e
[Feature] Add logger info and remove dataset bugs (#61) 
* Add logger info and remove dataset bugs

* fix typo
 2023-07-17 14:26:30 +08:00
Tong Gao
7ee5a86fee
[Feature] Enhance OpenAI API, add example config for GPT evaluation (#53) 
* [Feature] Enhance OpenAI API, add example config for GPT evaluation

* fix
 2023-07-12 16:43:46 +08:00
Hubert
f5103f93dd
[Feat] add bs for perspective api eval (#50) 
* [Feat] add bs for perspective api eval

* fix according to comments

* fix according to comments
 2023-07-12 16:26:01 +08:00
Hubert
c8f1d513b2
[Fix] fix clp inferencer (#44) 2023-07-11 14:54:39 +08:00
Tong Gao
0625294e5f
[Fix] Fix OpenICLInferTask (#41) 2023-07-10 16:12:01 +08:00
Ma Zerun
805293a9f2
Auto re-generate port number during retry (#24) 
* Auto re-generate port number during retry

* Fix slurm command
 2023-07-07 17:25:56 +08:00
Hubert
7f8eee4725
[Docs] add en docs (#15) 
* add en docs

* update

---------

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
 2023-07-06 12:58:44 +08:00
Leymore
86d5ec3d0f
Update configs (#9) 
* Update implements

* Update
 2023-07-06 12:27:41 +08:00
Hubert
5c19c8c5fc
[Docs] add issue and pr template (#12) 
* [Feat] add issue and pr template

* minor add utils

* minor fix
 2023-07-06 11:55:01 +08:00
Tong Gao
986a44cedd
Tranlate lark messages (#5) 2023-07-05 18:40:05 +08:00
Tong Gao
719ba34d1b
[Enhancement] Update prompt hash computation (#2) 2023-07-05 18:29:07 +08:00
Ma Zerun
5840c7655c
Update start guide (#4) 2023-07-05 18:26:26 +08:00
yuzhaohui
dcf11cf8fd New logo and update setup.py 2023-07-05 06:54:06 +00:00
mzr1996
04dd01a235 Update configs and code 2023-07-05 11:45:08 +08:00
Leymore
c94cc94348 Add release contribution 2023-07-05 03:15:31 +00:00
tonysy
e6b5bdcb87 OpenCompass Public MR 2023-07-05 03:15:21 +00:00
Ezra-Yu
cbe9fe2cdb Add Release Contraibution 2023-07-05 02:22:40 +00:00
cky
36f111100f update datasets 2023-07-05 01:45:26 +00:00
mzr1996
3cfe73de3f Support a batch of datasets. 2023-07-05 01:30:27 +00:00
kennymckormick
78478e961e [Code] Update opencompass/datasets/agieval/__init__.py 2023-07-05 00:28:07 +00:00
yingfhu
fb11108723 [Feat] support opencompass 2023-07-04 22:11:33 +08:00
gaotongxiao
7d346000bb initial commit 2023-07-04 21:34:55 +08:00