Haonan Li
|
e9cdb24ddd
|
[Feature] Add CMMLU dataset (#91)
* add CMMLU
* debug cmmlu
* add slurm args `qos`
* fix format: space before comment
* remove unused variable
* change the location of `answer is`
---------
Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>
|
2023-07-25 10:14:27 +08:00 |
|
Haodong Duan
|
6e885d668b
|
force utf-8 encoding for all non-dataset fileios (#97)
|
2023-07-25 10:06:01 +08:00 |
|
Leymore
|
3fe5ee096c
|
[Feature] Add heuristic size partitioner (#63)
* [Feature] Add heuristic size partitioner
* update
|
2023-07-20 11:53:24 +08:00 |
|
Leymore
|
eea8b04417
|
[Feature] Add llama-2 models (#81)
* add llama-2 models
* update docs
---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
|
2023-07-19 19:51:29 +08:00 |
|
Hubert
|
f83e125e5a
|
[Feat] Support CValues Responsibility dataset (#78)
* [Feat] support CValues
* minor fix
|
2023-07-18 18:45:15 +08:00 |
|
LZH
|
26e2f171f4
|
[Feature] Support load PEFT adapter for HuggingFace model (#74)
* support peft for HuggingFace model
* add docstring
|
2023-07-18 16:21:43 +08:00 |
|
liushz
|
f36c0496f3
|
[Feature] Add tydiqa-goldp (#75)
Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
|
2023-07-18 14:54:35 +08:00 |
|
Tong Gao
|
311bf0daa7
|
[Fix] Fix CI (#70)
* [Fix] Fix CI
* [Fix] Fix CI
* [Fix] Fix CI
* update
|
2023-07-17 19:10:59 +08:00 |
|
Tong Gao
|
29006e39c0
|
[Fix] Fix circular import of PromptTemplate (#71)
|
2023-07-17 19:09:38 +08:00 |
|
Tong Gao
|
1e44541730
|
[Enhancement] Test linting in CI and fix existing linting errors (#69)
* [Enhancement] Test linting in CI
* fix linting
|
2023-07-17 15:59:10 +08:00 |
|
Leymore
|
1326aff77e
|
[Feature] Add logger info and remove dataset bugs (#61)
* Add logger info and remove dataset bugs
* fix typo
|
2023-07-17 14:26:30 +08:00 |
|
Tong Gao
|
7ee5a86fee
|
[Feature] Enhance OpenAI API, add example config for GPT evaluation (#53)
* [Feature] Enhance OpenAI API, add example config for GPT evaluation
* fix
|
2023-07-12 16:43:46 +08:00 |
|
Hubert
|
f5103f93dd
|
[Feat] add bs for perspective api eval (#50)
* [Feat] add bs for perspective api eval
* fix according to comments
* fix according to comments
|
2023-07-12 16:26:01 +08:00 |
|
Hubert
|
c8f1d513b2
|
[Fix] fix clp inferencer (#44)
|
2023-07-11 14:54:39 +08:00 |
|
Tong Gao
|
0625294e5f
|
[Fix] Fix OpenICLInferTask (#41)
|
2023-07-10 16:12:01 +08:00 |
|
Ma Zerun
|
805293a9f2
|
Auto re-generate port number during retry (#24)
* Auto re-generate port number during retry
* Fix slurm command
|
2023-07-07 17:25:56 +08:00 |
|
Hubert
|
7f8eee4725
|
[Docs] add en docs (#15)
* add en docs
* update
---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
|
2023-07-06 12:58:44 +08:00 |
|
Leymore
|
86d5ec3d0f
|
Update configs (#9)
* Update implements
* Update
|
2023-07-06 12:27:41 +08:00 |
|
Hubert
|
5c19c8c5fc
|
[Docs] add issue and pr template (#12)
* [Feat] add issue and pr template
* minor add utils
* minor fix
|
2023-07-06 11:55:01 +08:00 |
|
Tong Gao
|
986a44cedd
|
Tranlate lark messages (#5)
|
2023-07-05 18:40:05 +08:00 |
|
Tong Gao
|
719ba34d1b
|
[Enhancement] Update prompt hash computation (#2)
|
2023-07-05 18:29:07 +08:00 |
|
Ma Zerun
|
5840c7655c
|
Update start guide (#4)
|
2023-07-05 18:26:26 +08:00 |
|
yuzhaohui
|
dcf11cf8fd
|
New logo and update setup.py
|
2023-07-05 06:54:06 +00:00 |
|
mzr1996
|
04dd01a235
|
Update configs and code
|
2023-07-05 11:45:08 +08:00 |
|
Leymore
|
c94cc94348
|
Add release contribution
|
2023-07-05 03:15:31 +00:00 |
|
tonysy
|
e6b5bdcb87
|
OpenCompass Public MR
|
2023-07-05 03:15:21 +00:00 |
|
Ezra-Yu
|
cbe9fe2cdb
|
Add Release Contraibution
|
2023-07-05 02:22:40 +00:00 |
|
cky
|
36f111100f
|
update datasets
|
2023-07-05 01:45:26 +00:00 |
|
mzr1996
|
3cfe73de3f
|
Support a batch of datasets.
|
2023-07-05 01:30:27 +00:00 |
|
kennymckormick
|
78478e961e
|
[Code] Update opencompass/datasets/agieval/__init__.py
|
2023-07-05 00:28:07 +00:00 |
|
yingfhu
|
fb11108723
|
[Feat] support opencompass
|
2023-07-04 22:11:33 +08:00 |
|
gaotongxiao
|
7d346000bb
|
initial commit
|
2023-07-04 21:34:55 +08:00 |
|