OpenCompass/configs
Li Bo a4d6840739
[Feat] Add Otter to OpenCompass MMBench Evaluation (#232)
* add otter model for opencompass mmbench

* add docs

* add readme docs

* debug for otter opencomass eval

* delete unused folders

* change to default data path

* remove unused files

* remove unused files

* update

* update config file

* flake8 lint formated and add prompt generator

* add prompt generator to config

* add a specific postproecss

* add post processor

* add post processor

* add post processor

* update according to suggestions

* remove unused redefinition
2023-08-31 12:55:53 +08:00
..
datasets [Feature] Add qwen & qwen-chat support (#286) 2023-08-31 11:29:05 +08:00
models [Feature] Add qwen & qwen-chat support (#286) 2023-08-31 11:29:05 +08:00
multimodal [Feat] Add Otter to OpenCompass MMBench Evaluation (#232) 2023-08-31 12:55:53 +08:00
summarizers [Feature] Add qwen & qwen-chat support (#286) 2023-08-31 11:29:05 +08:00
eval_claude.py [Feature] Support model-bound prediction postprocessor, use it in Claude (#268) 2023-08-25 16:12:21 +08:00
eval_codegeex2.py [Feat] Add codegeex2 and Humanevalx (#210) 2023-08-17 11:03:16 +08:00
eval_demo.py [Doc] Update logo icon (#32) 2023-07-08 16:40:24 +08:00
eval_gpt3.5.py [Feature] Calculate max_out_len without hard code for OpenAI model (#158) 2023-08-08 15:16:56 +08:00
eval_gpt4.py [Enhancement] Add humaneval postprocessor for GPT models & eval config for GPT4, enhance the original humaneval postprocessor (#129) 2023-08-10 16:31:12 +08:00
eval_hf_llama_7b.py [Feature] Add llama2 native implements (#235) 2023-08-23 11:33:25 +08:00
eval_internlm_7b.py Add models (#18) 2023-07-06 16:02:39 +08:00
eval_internlm_chat_7b_turbomind.py [Feature] Support turbomind (#166) 2023-08-10 16:25:11 +08:00
eval_internLM.py [Feature] Support intern lanuage model (#51) 2023-07-27 18:49:36 +08:00
eval_llama2_7b.py [Feature] Add llama2 native implements (#235) 2023-08-23 11:33:25 +08:00
eval_qwen_7b_chat.py [Feature] Add qwen & qwen-chat support (#286) 2023-08-31 11:29:05 +08:00
eval_qwen_7b.py [Feature] Add qwen & qwen-chat support (#286) 2023-08-31 11:29:05 +08:00