Alexander Lam 35c94d0cde [Feature] Adding support for LLM Compression Evaluation (#1108) ... * fixed formatting based on pre-commit tests * fixed typo in comments; reduced the number of models in the eval config * fixed a bug in LLMCompressionDataset, where setting samples=None would result in passing test[:None] to load_dataset * removed unnecessary variable in _format_table_pivot; changed lark_reporter message to English		2024-04-30 10:51:01 +08:00
..
__init__.py	[Feature] Adding support for LLM Compression Evaluation (#1108)	2024-04-30 10:51:01 +08:00
icl_agent_inferencer.py	[Feat] minor update agent related (#839)	2024-01-26 14:15:51 +08:00
icl_attack_inferencer.py	[Fix] change save_every defaults to 1 (#592)	2023-11-15 13:00:25 +08:00
icl_base_inferencer.py	[Sync] update (#517)	2023-10-27 20:31:22 +08:00
icl_chat_inferencer.py	[Fix] Fix MultiRound Subjective Evaluation(#1043)	2024-04-22 12:06:03 +08:00
icl_clp_inferencer.py	[Refactor] Move fix_id_list to Retriever (#442)	2023-10-07 12:53:41 +08:00
icl_gen_inferencer.py	[Sync] Add InternLM2 Keyset Evaluation Demo (#807)	2024-01-17 13:48:12 +08:00
icl_ll_inferencer.py	[Sync] Sync with internal codes 2023.01.08 (#777)	2024-01-08 14:07:24 +00:00
icl_mink_percent_inferencer.py	[Sync] Sync with internal codes 2023.01.08 (#777)	2024-01-08 14:07:24 +00:00
icl_ppl_inferencer.py	Fix LightllmApi ppl test (#951)	2024-03-08 12:04:44 +08:00
icl_ppl_only_inferencer.py	[Sync] minor test (#683)	2023-12-11 17:42:53 +08:00
icl_sc_inferencer.py	[Fix] change save_every defaults to 1 (#592)	2023-11-15 13:00:25 +08:00
icl_sw_ce_loss_inferencer.py	[Feature] Adding support for LLM Compression Evaluation (#1108)	2024-04-30 10:51:01 +08:00
icl_tot_inferencer.py	[Fix] change save_every defaults to 1 (#592)	2023-11-15 13:00:25 +08:00