OpenCompass/configs/multimodal/minigpt_4
2023-08-17 18:26:01 +08:00
..
minigpt_4_7b_coco_caption.py [Feature]: Add other public datasets (#206) 2023-08-16 11:37:26 +08:00
minigpt_4_7b_flickr30k.py [Feature]: Add other public datasets config (#214) 2023-08-17 11:11:26 +08:00
minigpt_4_7b_gqa.py [Feature]: Add other public datasets config (#214) 2023-08-17 11:11:26 +08:00
minigpt_4_7b_mmbench.py [Feature]: Add other public datasets (#206) 2023-08-16 11:37:26 +08:00
minigpt_4_7b_ocr-vqa.py [Feature]: Add other public datasets config (#214) 2023-08-17 11:11:26 +08:00
minigpt_4_7b_ok-vqa.py [Feature]: Add other public datasets config (#214) 2023-08-17 11:11:26 +08:00
minigpt_4_7b_scienceqa.py [Feature]: Add other public datasets (#206) 2023-08-16 11:37:26 +08:00
minigpt_4_7b_seedbench.py [Feature] Support SEED-Bench (#203) 2023-08-17 17:24:02 +08:00
minigpt_4_7b_textvqa.py [Feature]: Add other public datasets config (#214) 2023-08-17 11:11:26 +08:00
minigpt_4_7b_vizwiz.py [Feature]: Add other public datasets config (#214) 2023-08-17 11:11:26 +08:00
minigpt_4_7b_vqav2.py [Feature]: Add other public datasets (#206) 2023-08-16 11:37:26 +08:00
minigpt_4_7b_vsr.py [Feature]: Add other public datasets (#206) 2023-08-16 11:37:26 +08:00
README.md [Feature]: Add launch script (#222) 2023-08-17 18:26:01 +08:00

MiniGPT-4

Prepare the environment

cd opencompass/multimodal/models/minigpt_4
git clone https://github.com/Vision-CAIR/MiniGPT-4.git

Then prepare the environement according to this doc

Start evaluation

Slurm

cd $root
python run.py configs/multimodal/tasks.py --mm-eval --slurm -p $PARTITION

PyTorch

cd $root
python run.py configs/multimodal/tasks.py