OpenCompass/configs/multimodal/minigpt_4
Surav Shrestha e5ae86221c
docs: fix typos in markdown files (#530)
* fix typos in configs/multimodal/llava/README.md

* fix typos in configs/multimodal/minigpt_4/README.md
2023-11-01 16:16:16 +08:00
..
minigpt_4_7b_coco_caption.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_flickr30k.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_gqa.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_mmbench.py [Fix]: Fix name (#223) 2023-08-17 18:30:48 +08:00
minigpt_4_7b_mme.py [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
minigpt_4_7b_ocr_vqa.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_ok_vqa.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_scienceqa.py [Fix]: Add has_image to scienceqa (#391) 2023-09-13 13:07:14 +08:00
minigpt_4_7b_seedbench.py [Feature] Support SEED-Bench (#203) 2023-08-17 17:24:02 +08:00
minigpt_4_7b_textvqa.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_vizwiz.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_vqav2.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_vsr.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
README.md docs: fix typos in markdown files (#530) 2023-11-01 16:16:16 +08:00

MiniGPT-4

Prepare the environment

cd opencompass/multimodal/models/minigpt_4
git clone https://github.com/Vision-CAIR/MiniGPT-4.git

Then prepare the environment according to this doc

Start evaluation

Slurm

cd $root
python run.py configs/multimodal/tasks.py --mm-eval --slurm -p $PARTITION

PyTorch

cd $root
python run.py configs/multimodal/tasks.py --mm-eval