jiangzhs/OpenCompass
1
0
Fork 0
mirror of https://github.com/open-compass/opencompass.git synced 2025-05-30 16:03:24 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
a11cb45c83
OpenCompass/configs/multimodal/minigpt_4
History
Yuan Liu 545d50a4c0
[Fix]: Add has_image to scienceqa (#391) 
Co-authored-by: bensenliu <bensenliu@tencent.com>
2023-09-13 13:07:14 +08:00
..
minigpt_4_7b_coco_caption.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_flickr30k.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_gqa.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_mmbench.py [Fix]: Fix name (#223) 2023-08-17 18:30:48 +08:00
minigpt_4_7b_mme.py [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
minigpt_4_7b_ocr_vqa.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_ok_vqa.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_scienceqa.py [Fix]: Add has_image to scienceqa (#391) 2023-09-13 13:07:14 +08:00
minigpt_4_7b_seedbench.py [Feature] Support SEED-Bench (#203) 2023-08-17 17:24:02 +08:00
minigpt_4_7b_textvqa.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_vizwiz.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_vqav2.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
minigpt_4_7b_vsr.py [Feature]: Verify the acc of these public datasets (#269) 2023-08-25 15:01:58 +08:00
README.md [Feature]: Add Flamingo (#258) 2023-08-24 14:11:29 +08:00

README.md

MiniGPT-4

Prepare the environment

cd opencompass/multimodal/models/minigpt_4
git clone https://github.com/Vision-CAIR/MiniGPT-4.git

Then prepare the environement according to this doc

Start evaluation

Slurm

cd $root
python run.py configs/multimodal/tasks.py --mm-eval --slurm -p $PARTITION

PyTorch

cd $root
python run.py configs/multimodal/tasks.py --mm-eval