Yike Yuan 8d368d1cd6 [Feat] Support visualglm and llava for MMBench evaluation. (#211) ... * [Feat] Support visualglm inference on MMBench. * [Feat] Support llava inference on MMBench. * [Fix] Fix pre-commit format. * [Fix] Add docstring for llava * [Fix] Fix multi-process inference error of LlaVA and add comments. 1. Set `low_cpu_mem_usage` to False to address device issue. 2. Add docstring and type hints. 3. Rename class and remove registry. * [Fix] Pre-commit fix. * [Fix] add forward entry, add dynamic import to seedbench * [Fix] Fix pre-commit. * [Fix] Fix missing context. * [Fix] Fix docstring.		2023-08-21 15:57:30 +08:00
..
datasets	[Dataset] LongBench (#236)	2023-08-21 14:15:20 +08:00
metrics	[Feat] Support multi-modal evaluation on MME benchmark. (#197)	2023-08-21 15:53:20 +08:00
models	[Fix] bin_trim (#237)	2023-08-21 15:44:49 +08:00
multimodal	[Feat] Support visualglm and llava for MMBench evaluation. (#211)	2023-08-21 15:57:30 +08:00
openicl	[Feat] add safety to collections (#185)	2023-08-11 11:19:26 +08:00
partitioners	[Feature]: Use multimodal (#73)	2023-08-03 11:07:50 +08:00
runners	[Feature] Support CUDA_VISIBLE_DEVICES and multiple tasks on one GPU (#148)	2023-08-10 16:53:03 +08:00
tasks	[Feature] Support SEED-Bench (#203)	2023-08-17 17:24:02 +08:00
utils	[Fix] fix bug for postprocessor (#195)	2023-08-11 18:41:12 +08:00
__init__.py	Bump version to 0.1.2 (#190)	2023-08-11 17:43:14 +08:00
registry.py	[Feature]: Use multimodal (#73)	2023-08-03 11:07:50 +08:00