Yuan Liu
|
dc6e54f6f4
|
[Feature]: Verify the acc of these public datasets (#269)
* [Feature]: Refactor public dataset eval
* [Feature]: Verify public dataset acc
|
2023-08-25 15:01:58 +08:00 |
|
Yuan Liu
|
343f785b07
|
[Feature]: Add Flamingo (#258)
* [Feature]: Add Openflamingo MMBench
* [Fix]: Fix import error
* [Fix]: Revert task config
* [Fix]: Fix path bug
|
2023-08-24 14:11:29 +08:00 |
|
Yixiao Fang
|
1034c487ef
|
[Refactor] Refactor instructblip (#227)
* refactor instructblip
* add post processor
* add forward
* fix lint
* update
* update
|
2023-08-23 15:33:59 +08:00 |
|
Yike Yuan
|
8d368d1cd6
|
[Feat] Support visualglm and llava for MMBench evaluation. (#211)
* [Feat] Support visualglm inference on MMBench.
* [Feat] Support llava inference on MMBench.
* [Fix] Fix pre-commit format.
* [Fix] Add docstring for llava
* [Fix] Fix multi-process inference error of LlaVA and add comments.
1. Set `low_cpu_mem_usage` to False to address device issue.
2. Add docstring and type hints.
3. Rename class and remove registry.
* [Fix] Pre-commit fix.
* [Fix] add forward entry, add dynamic import to seedbench
* [Fix] Fix pre-commit.
* [Fix] Fix missing context.
* [Fix] Fix docstring.
|
2023-08-21 15:57:30 +08:00 |
|
Yike Yuan
|
a6552224cb
|
[Feat] Support multi-modal evaluation on MME benchmark. (#197)
* [Feat] Support multi-modal evaluation on MME benchmark.
* [Fix] Remove debug code.
* [Fix] Remove redundant codes and add type hints.
* [Fix] Rename in config.
* [Fix] Rebase main.
* [Fix] Fix isort and yapf conflict.
|
2023-08-21 15:53:20 +08:00 |
|
Yixiao Fang
|
0fa2482661
|
[Feature] Support SEED-Bench (#203)
* support seedbench
* update docstrings
* update
* update
* update
* update according to review
* rebase
* fix lint
* update
|
2023-08-17 17:24:02 +08:00 |
|
Yuan Liu
|
78df9bd0cb
|
[Feature]: Add other public datasets (#206)
* [Feature]: Refactor class name
* [Feature]: Add minigpt-4 coco caption
* [Feature]: Update minigpt-4 coco caption
* [Feature]: Add MiniGPT-4 ScienceQA
* [Feature]: Add minigpt-4 vqav2
* [Feature]: Add VSR
* [Feature]: Revert task to previous version
|
2023-08-16 11:37:26 +08:00 |
|
Yuan Liu
|
a205629ff3
|
[Feature]: Refactor input and output (#176)
* [Feature]: Refactor input and output
* [Feature]: Update tasks
|
2023-08-10 14:01:28 +08:00 |
|
Yuan Liu
|
191a3f6f9d
|
[Feature]: Use multimodal (#73)
* [Feature]: Add minigpt-4
* [Feature]: Add mm local runner
* [Feature]: Add instructblip
* [Feature]: Delete redundant file
* [Feature]: Delete redundant file
* [Feature]: Add README to InstructBLIP
* [Feature]: Update MiniGPT-4
* [Fix]: Fix lint
* [Feature]add omnibenchmark readme (#49)
* add omnibenchmark readme
* fix
* Update OmniMMBench.md
* Update OmniMMBench.md
* Update OmniMMBench.md
* [Fix]: Refine name (#54)
* [Feature]: Unify out and err
* [Fix]: Fix lint
* [Feature]: Rename to mmbench and change weight path
* [Feature]: Delete Omni in instructblip
* [Feature]: Check the avaliablity of lavis
* [Fix]: Fix lint
* [Feature]: Refactor MM
* [Refactor]: Refactor path
* [Feature]: Delete redundant files
* [Refactor]: Delete redundant files
---------
Co-authored-by: Wangbo Zhao(黑色枷锁) <56866854+wangbo-zhao@users.noreply.github.com>
|
2023-08-03 11:07:50 +08:00 |
|