17 Commits

Author	SHA1	Message	Date
Tong Gao	c00179d46b	[Feature] Evaluating acc based on minimum edit distance, update SIQA (#130) ... * [Feature] Support evaluating acc based on minimum edit distance, update SIQA * update	2023-08-01 14:24:27 +08:00
Leymore	d862f570aa	[Feature] Add SC (#126) ... * add self-consistency * add CoT method Self-Consistency * fix typo error and update openicl_eval * add tydiQA-GoldP task * fix sc * rename gsm8k_sc * fix sc * add self-consistency doc * refine sc --------- Authored-by: liushz <qq1791167085@163.com>	2023-07-28 17:29:37 +08:00
Haodong Duan	538b439302	[Fix] Fix seed in HFEvaluator (#122)	2023-07-28 11:29:01 +08:00
Haodong Duan	6e885d668b	force utf-8 encoding for all non-dataset fileios (#97)	2023-07-25 10:06:01 +08:00
Tong Gao	311bf0daa7	[Fix] Fix CI (#70) ... * [Fix] Fix CI * [Fix] Fix CI * [Fix] Fix CI * update	2023-07-17 19:10:59 +08:00
Tong Gao	29006e39c0	[Fix] Fix circular import of PromptTemplate (#71)	2023-07-17 19:09:38 +08:00
Tong Gao	1e44541730	[Enhancement] Test linting in CI and fix existing linting errors (#69) ... * [Enhancement] Test linting in CI * fix linting	2023-07-17 15:59:10 +08:00
Hubert	f5103f93dd	[Feat] add bs for perspective api eval (#50) ... * [Feat] add bs for perspective api eval * fix according to comments * fix according to comments	2023-07-12 16:26:01 +08:00
Hubert	c8f1d513b2	[Fix] fix clp inferencer (#44)	2023-07-11 14:54:39 +08:00
Leymore	86d5ec3d0f	Update configs (#9) ... * Update implements * Update	2023-07-06 12:27:41 +08:00
Leymore	c94cc94348	Add release contribution	2023-07-05 03:15:31 +00:00
tonysy	e6b5bdcb87	OpenCompass Public MR	2023-07-05 03:15:21 +00:00
Ezra-Yu	cbe9fe2cdb	Add Release Contraibution	2023-07-05 02:22:40 +00:00
cky	36f111100f	update datasets	2023-07-05 01:45:26 +00:00
mzr1996	3cfe73de3f	Support a batch of datasets.	2023-07-05 01:30:27 +00:00
yingfhu	fb11108723	[Feat] support opencompass	2023-07-04 22:11:33 +08:00
gaotongxiao	7d346000bb	initial commit	2023-07-04 21:34:55 +08:00