mirror of
https://github.com/open-compass/opencompass.git
synced 2025-05-30 16:03:24 +08:00
bd50bad8b5
* [Feat] Add public dataset support for visualglm, qwenvl, and flamingo * [Fix] MMBench related changes. * [Fix] Openflamingo inference. * [Fix] Hide ckpt path. * [Fix] Pre-commit. --------- Co-authored-by: Haodong Duan <dhd.efz@gmail.com>
24 lines
327 B
Markdown
24 lines
327 B
Markdown
# OTTER: Multi-modal In-context Instruction Tuning.
|
|
|
|
### Prepare the environment
|
|
|
|
```sh
|
|
pip install otter_ai
|
|
```
|
|
|
|
### Start evaluation
|
|
|
|
#### Slurm
|
|
|
|
```sh
|
|
cd $root
|
|
python run.py configs/multimodal/tasks.py --mm-eval --slurm -p $PARTITION
|
|
```
|
|
|
|
#### PyTorch
|
|
|
|
|
|
```sh
|
|
cd $root
|
|
python run.py configs/multimodal/tasks.py --mm-eval
|
|
``` |