OpenCompass/opencompass/runners
Haonan Li e9cdb24ddd
[Feature] Add CMMLU dataset (#91)
* add CMMLU

* debug cmmlu

* add slurm args `qos`

* fix format: space before comment

* remove unused variable

* change the location of `answer is`

---------

Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>
2023-07-25 10:14:27 +08:00
..
__init__.py Update configs and code 2023-07-05 11:45:08 +08:00
base.py Tranlate lark messages (#5) 2023-07-05 18:40:05 +08:00
dlc.py Auto re-generate port number during retry (#24) 2023-07-07 17:25:56 +08:00
local.py Auto re-generate port number during retry (#24) 2023-07-07 17:25:56 +08:00
slurm.py [Feature] Add CMMLU dataset (#91) 2023-07-25 10:14:27 +08:00