OpenCompass/opencompass
Haonan Li e9cdb24ddd
[Feature] Add CMMLU dataset (#91)
* add CMMLU

* debug cmmlu

* add slurm args `qos`

* fix format: space before comment

* remove unused variable

* change the location of `answer is`

---------

Co-authored-by: 李浩楠 <lihaonan@lihaonandeMacBook-Air.local>
Co-authored-by: 李浩楠 <haonan.li>
Co-authored-by: Leymore <zfz-960727@163.com>
2023-07-25 10:14:27 +08:00
..
datasets [Feature] Add CMMLU dataset (#91) 2023-07-25 10:14:27 +08:00
models [Feature] Add llama-2 models (#81) 2023-07-19 19:51:29 +08:00
openicl force utf-8 encoding for all non-dataset fileios (#97) 2023-07-25 10:06:01 +08:00
partitioners [Feature] Add heuristic size partitioner (#63) 2023-07-20 11:53:24 +08:00
runners [Feature] Add CMMLU dataset (#91) 2023-07-25 10:14:27 +08:00
tasks [Feature] Add logger info and remove dataset bugs (#61) 2023-07-17 14:26:30 +08:00
utils force utf-8 encoding for all non-dataset fileios (#97) 2023-07-25 10:06:01 +08:00
__init__.py New logo and update setup.py 2023-07-05 06:54:06 +00:00
registry.py Add release contribution 2023-07-05 03:15:31 +00:00