Bob Tsang dd0b655bd0 [Feature] Support MMMLU & MMMLU-lite Benchmark (#1565) ... * rm folder * modify format according to reviewer * modify format according to reviewer * modify format according to reviewer * add some files requirement * fix some bug * fix bug * change load type * Update MMMLU Dataset * Update MMMLU Dataset * Add MMMLU-Lite Dataset * update MMMMLU datast * update MMMMLU datast * update MMMMLU datast --------- Co-authored-by: BobTsang <BobTsang1995@gmail.com> Co-authored-by: liushz <qq1791167085@163.com>		2024-10-17 19:09:34 +08:00
..
cli	[Feature] Support import configs/models/summarizers from whl (#1376)	2024-08-01 00:42:48 +08:00
configs	[Feature] Support MMMLU & MMMLU-lite Benchmark (#1565)	2024-10-17 19:09:34 +08:00
datasets	[Feature] Support MMMLU & MMMLU-lite Benchmark (#1565)	2024-10-17 19:09:34 +08:00
lagent	Update CIBench (#1089)	2024-04-26 18:46:02 +08:00
metrics	[Feat] Support multi-modal evaluation on MME benchmark. (#197)	2023-08-21 15:53:20 +08:00
models	[Fix] fix interntrain's tokenizer truncate (#1605)	2024-10-15 16:03:57 +08:00
openicl	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
partitioners	[Fix] fix duplicate error in partitioner (#1552)	2024-09-23 19:45:21 +08:00
runners	[Fix] Update dlc runner python env (#1604)	2024-10-14 15:50:21 +08:00
summarizers	Upload HelloBench (#1607)	2024-10-15 17:11:37 +08:00
tasks	[Feature] Add model postprocess function (#1484)	2024-09-05 21:10:29 +08:00
utils	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00
__init__.py	[BUMP] Bump version to 0.3.3 (#1581)	2024-09-30 16:57:41 +08:00
registry.py	[Feature] Add Judgerbench and reorg subeval (#1593)	2024-10-15 16:36:05 +08:00