OpenCompass/configs/multimodal/openflamingo
Yike Yuan bd50bad8b5
[Feat] Support mm models on public dataset and fix several issues. (#412)
* [Feat] Add public dataset support for visualglm, qwenvl, and flamingo

* [Fix] MMBench related changes.

* [Fix] Openflamingo inference.

* [Fix] Hide ckpt path.

* [Fix] Pre-commit.

---------

Co-authored-by: Haodong Duan <dhd.efz@gmail.com>
2023-09-19 19:08:44 +08:00
..
openflamingo_coco_caption.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_flickr30k.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_gqa.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_mmbench.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_ocr_vqa.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_ok_vqa.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_scienceqa.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_textvqa.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_vizwiz.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_vqav2.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
openflamingo_vsr.py [Feat] Support mm models on public dataset and fix several issues. (#412) 2023-09-19 19:08:44 +08:00
README.md [Feature]: Add Flamingo (#258) 2023-08-24 14:11:29 +08:00

OpenFlamingo

Prepare the environment

Install MMPretrain according to this doc

Start evaluation

Slurm

cd $root
python run.py configs/multimodal/tasks.py --mm-eval --slurm -p $PARTITION

PyTorch

cd $root
python run.py configs/multimodal/tasks.py --mm-eval