OpenCompass/opencompass
Yike Yuan a6552224cb
[Feat] Support multi-modal evaluation on MME benchmark. (#197)
* [Feat] Support multi-modal evaluation on MME benchmark.

* [Fix] Remove debug code.

* [Fix] Remove redundant codes and add type hints.

* [Fix] Rename in config.

* [Fix] Rebase main.

* [Fix] Fix isort and yapf conflict.
2023-08-21 15:53:20 +08:00
..
datasets [Dataset] LongBench (#236) 2023-08-21 14:15:20 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Fix] bin_trim (#237) 2023-08-21 15:44:49 +08:00
multimodal [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
openicl [Feat] add safety to collections (#185) 2023-08-11 11:19:26 +08:00
partitioners [Feature]: Use multimodal (#73) 2023-08-03 11:07:50 +08:00
runners [Feature] Support CUDA_VISIBLE_DEVICES and multiple tasks on one GPU (#148) 2023-08-10 16:53:03 +08:00
tasks [Feature] Support SEED-Bench (#203) 2023-08-17 17:24:02 +08:00
utils [Fix] fix bug for postprocessor (#195) 2023-08-11 18:41:12 +08:00
__init__.py Bump version to 0.1.2 (#190) 2023-08-11 17:43:14 +08:00
registry.py [Feature]: Use multimodal (#73) 2023-08-03 11:07:50 +08:00