10 Commits

Author	SHA1	Message	Date
Alexander Lam	35c94d0cde	[Feature] Adding support for LLM Compression Evaluation (#1108) ... * fixed formatting based on pre-commit tests * fixed typo in comments; reduced the number of models in the eval config * fixed a bug in LLMCompressionDataset, where setting samples=None would result in passing test[:None] to load_dataset * removed unnecessary variable in _format_table_pivot; changed lark_reporter message to English	2024-04-30 10:51:01 +08:00
Fengzhe Zhou	9afbfa3639	[Sync] Fix TEvalEvaluator (#929)	2024-02-28 16:05:30 +08:00
Fengzhe Zhou	32f40a8f83	[Sync] Sync with internal codes 2023.01.08 (#777)	2024-01-08 14:07:24 +00:00
Hubert	e78857ac36	[Sync] minor test (#683)	2023-12-11 17:42:53 +08:00
liushz	2737249f31	[Feature] Add mathbench dataset and circular evaluator (#408) ... * add_mathbench * update mathbench * support non circular eval dataset --------- Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn> Co-authored-by: yingfhu <yingfhu@gmail.com>	2023-10-18 04:08:31 -05:00
Leymore	d7ff933a73	[Fix] Use jieba rouge in lcsts (#459) ... * use jieba rouge in lcsts * use rouge_chinese	2023-10-09 10:10:33 +08:00
Tong Gao	a1ea3c094a	[Sync] Initial support of subjective evaluation (#421) ... Co-authored-by: Leymore <zfz-960727@163.com>	2023-09-22 15:42:31 +08:00
Ma Zerun	0f2c388280	Support GSM8k evaluation with tools by Lagent and LangChain (#277) ... * Support GSM8k evaluation with tools by Lagent and LangChain * Avoid to use MMEngine new feature * update document --------- Co-authored-by: Leymore <zfz-960727@163.com>	2023-09-22 15:28:22 +08:00
Tong Gao	1e44541730	[Enhancement] Test linting in CI and fix existing linting errors (#69) ... * [Enhancement] Test linting in CI * fix linting	2023-07-17 15:59:10 +08:00
yingfhu	fb11108723	[Feat] support opencompass	2023-07-04 22:11:33 +08:00