OpenCompass/configs/multimodal/llava
Yike Yuan bd50bad8b5
[Feat] Support mm models on public dataset and fix several issues. (#412)
* [Feat] Add public dataset support for visualglm, qwenvl, and flamingo

* [Fix] MMBench related changes.

* [Fix] Openflamingo inference.

* [Fix] Hide ckpt path.

* [Fix] Pre-commit.

---------

Co-authored-by: Haodong Duan <dhd.efz@gmail.com>
2023-09-19 19:08:44 +08:00
..
llava_7b_coco_caption.py [Feat] Support public dataset of visualglm and llava. (#265) 2023-08-25 15:44:32 +08:00
llava_7b_flickr30k.py [Feat] Support public dataset of visualglm and llava. (#265) 2023-08-25 15:44:32 +08:00
llava_7b_gqa.py [Feat] Support public dataset of visualglm and llava. (#265) 2023-08-25 15:44:32 +08:00
llava_7b_mmbench.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
llava_7b_ocr_vqa.py [Feat] Support public dataset of visualglm and llava. (#265) 2023-08-25 15:44:32 +08:00
llava_7b_ok_vqa.py [Feat] Support public dataset of visualglm and llava. (#265) 2023-08-25 15:44:32 +08:00
llava_7b_scienceqa.py [Fix]: Add has_image to scienceqa (#391) 2023-09-13 13:07:14 +08:00
llava_7b_textvqa.py [Feat] Support public dataset of visualglm and llava. (#265) 2023-08-25 15:44:32 +08:00
llava_7b_vizwiz.py [Feat] Support public dataset of visualglm and llava. (#265) 2023-08-25 15:44:32 +08:00
llava_7b_vqav2.py [Feat] Support public dataset of visualglm and llava. (#265) 2023-08-25 15:44:32 +08:00
llava_7b_vsr.py [Feat] Support public dataset of visualglm and llava. (#265) 2023-08-25 15:44:32 +08:00
README.md [Feat] Support visualglm and llava for MMBench evaluation. (#211) 2023-08-21 15:57:30 +08:00

LLaVA

Prepare the environment

cd opencompass/multimodal/models/llava
git clone https://github.com/haotian-liu/LLaVA.git

Then prepare the environement according to the install instruction