OpenCompass/opencompass/summarizers
Alexander Lam 35c94d0cde
[Feature] Adding support for LLM Compression Evaluation (#1108)
* fixed formatting based on pre-commit tests

* fixed typo in comments; reduced the number of models in the eval config

* fixed a bug in LLMCompressionDataset, where setting samples=None would result in passing test[:None] to load_dataset

* removed unnecessary variable in _format_table_pivot; changed lark_reporter message to English
2024-04-30 10:51:01 +08:00
..
subjective [Fix] Fix Math Evaluation with Judge Model Evaluator & Add README (#1103) 2024-04-28 21:58:58 +08:00
__init__.py [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
circular.py [Feature] Add circular eval (#610) 2023-11-23 16:45:47 +08:00
default.py Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
llm_compression.py [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
multi_model.py [Feature] Add multi model viz (#509) 2023-10-30 12:11:33 +08:00
needlebench.py [Sync] deprecate old mbpps (#1064) 2024-04-19 20:49:46 +08:00
summarizer_pretrain.py [Sync] Sync with internal codes 2023.01.08 (#777) 2024-01-08 14:07:24 +00:00