OpenCompass/opencompass/openicl
Alexander Lam 35c94d0cde
[Feature] Adding support for LLM Compression Evaluation (#1108)
* fixed formatting based on pre-commit tests

* fixed typo in comments; reduced the number of models in the eval config

* fixed a bug in LLMCompressionDataset, where setting samples=None would result in passing test[:None] to load_dataset

* removed unnecessary variable in _format_table_pivot; changed lark_reporter message to English
2024-04-30 10:51:01 +08:00
..
icl_evaluator [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
icl_inferencer [Feature] Adding support for LLM Compression Evaluation (#1108) 2024-04-30 10:51:01 +08:00
icl_retriever [Feature] Add support for MiniMax API (#548) 2023-11-06 21:57:32 +08:00
utils [Enhancement] Test linting in CI and fix existing linting errors (#69) 2023-07-17 15:59:10 +08:00
__init__.py [Enhancement] Test linting in CI and fix existing linting errors (#69) 2023-07-17 15:59:10 +08:00
icl_dataset_reader.py [Sync] Initial support of subjective evaluation (#421) 2023-09-22 15:42:31 +08:00
icl_prompt_template.py [Sync] update taco (#1030) 2024-04-09 17:50:23 +08:00