OpenCompass/opencompass
Alexander Lam 35c94d0cde
[Feature] Adding support for LLM Compression Evaluation (#1108)
* fixed formatting based on pre-commit tests

* fixed typo in comments; reduced the number of models in the eval config

* fixed a bug in LLMCompressionDataset, where setting samples=None would result in passing test[:None] to load_dataset

* removed unnecessary variable in _format_table_pivot; changed lark_reporter message to English
2024-04-30 10:51:01 +08:00
..
cli [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00
datasets [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models adapt to lmdeploy v0.4.0 (#1073) 2024-04-28 19:57:40 +08:00
openicl [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
partitioners [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00
runners [Fix] Fix sequential runner (#1070) 2024-04-23 11:31:10 +08:00
summarizers [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
tasks [Fix] python path bug (#1063) 2024-04-26 21:58:45 +08:00
utils fix output typing, change mutable list to immutable tuple (#989) 2024-04-26 23:07:34 +08:00
__init__.py [Sync] Bump version to 0.2.4 (#1052) 2024-04-16 18:09:46 +08:00
registry.py [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00