OpenCompass/opencompass
Li Bo a4d6840739
[Feat] Add Otter to OpenCompass MMBench Evaluation (#232)
* add otter model for opencompass mmbench

* add docs

* add readme docs

* debug for otter opencomass eval

* delete unused folders

* change to default data path

* remove unused files

* remove unused files

* update

* update config file

* flake8 lint formated and add prompt generator

* add prompt generator to config

* add a specific postproecss

* add post processor

* add post processor

* add post processor

* update according to suggestions

* remove unused redefinition
2023-08-31 12:55:53 +08:00
..
datasets [Feature] Add qwen & qwen-chat support (#286) 2023-08-31 11:29:05 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Feature] Simplify entry script (#204) 2023-08-25 17:36:30 +08:00
multimodal [Feat] Add Otter to OpenCompass MMBench Evaluation (#232) 2023-08-31 12:55:53 +08:00
openicl [Feature] Add Tree-of-Thought method (#173) 2023-08-23 12:23:05 +08:00
partitioners [Feature] Add qwen & qwen-chat support (#286) 2023-08-31 11:29:05 +08:00
runners [Fix] local runner debug (#238) 2023-08-21 16:58:36 +08:00
tasks [Feature] Support model-bound prediction postprocessor, use it in Claude (#268) 2023-08-25 16:12:21 +08:00
utils [Feature] Simplify entry script (#204) 2023-08-25 17:36:30 +08:00
__init__.py Bump version to 0.1.2 (#190) 2023-08-11 17:43:14 +08:00
registry.py [Feature] Add Tree-of-Thought method (#173) 2023-08-23 12:23:05 +08:00