mirror of
https://github.com/open-compass/opencompass.git
synced 2025-05-30 16:03:24 +08:00
a4d6840739
* add otter model for opencompass mmbench * add docs * add readme docs * debug for otter opencomass eval * delete unused folders * change to default data path * remove unused files * remove unused files * update * update config file * flake8 lint formated and add prompt generator * add prompt generator to config * add a specific postproecss * add post processor * add post processor * add post processor * update according to suggestions * remove unused redefinition
27 lines
516 B
Markdown
27 lines
516 B
Markdown
# OTTER: Multi-modal In-context Instruction Tuning.
|
|
|
|
### Prepare the environment
|
|
|
|
```sh
|
|
cd opencompass/multimodal/models/otter
|
|
git clone https://github.com/Luodian/Otter.git
|
|
```
|
|
|
|
Then create a new conda environment and prepare the environement according to this [doc](https://github.com/Luodian/Otter)
|
|
|
|
### Start evaluation
|
|
|
|
#### Slurm
|
|
|
|
```sh
|
|
cd $root
|
|
python run.py configs/multimodal/tasks.py --mm-eval --slurm -p $PARTITION
|
|
```
|
|
|
|
#### PyTorch
|
|
|
|
|
|
```sh
|
|
cd $root
|
|
python run.py configs/multimodal/tasks.py --mm-eval
|
|
``` |