OpenCompass/opencompass
Linchen Xiao a4b54048ae
[Feature] Add Ruler datasets (#1310)
* [Feature] Add Ruler datasets

* pre-commit fixed

* Add model specific tokenizer to dataset

* pre-commit modified

* remove unused import

* fix linting

* add trust_remote to tokenizer load

* lint fix

* comments resolved

* fix lint

* Add readme

* Fix lint

* ruler refactorize

* fix lint

* lint fix

* updated

* lint fix

* fix wonderwords import issue

* prompt modified

* update

* readme updated

* update

* ruler dataset added

* Update

---------

Co-authored-by: tonysy <sy.zhangbuaa@gmail.com>
2024-08-20 11:40:11 +08:00
..
cli [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
configs [Feature] Add Ruler datasets (#1310) 2024-08-20 11:40:11 +08:00
datasets [Feature] Add Ruler datasets (#1310) 2024-08-20 11:40:11 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Update] Compassbench v1.3 (#1396) 2024-08-12 19:09:19 +08:00
openicl [Feature] Support inference ppl datasets (#1315) 2024-07-22 17:59:30 +08:00
partitioners [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
runners [Doc] Update README (#1404) 2024-08-08 16:18:33 +08:00
summarizers [Fix] Sub summarizer order fix (#1426) 2024-08-15 21:08:18 +08:00
tasks [Fix] Fix Slurm ENV (#1392) 2024-08-06 01:35:20 +08:00
utils [Feature] Add Ruler datasets (#1310) 2024-08-20 11:40:11 +08:00
__init__.py [Bump] Bump version for v0.3.0 (#1398) 2024-08-07 01:25:24 +08:00
registry.py [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00