OpenCompass/opencompass
Jingming 5e75e29711
[Feature] Add multi-prompt generation demo (#568)
* [Feature] Add multi-prompt generation demo

* [Fix] change form in winogrande_gen_XXX.py

* [Fix] make multi prompt demo more directly

* [Fix] fix bug

* [Fix] minor fix

---------

Co-authored-by: yingfhu <yingfhu@gmail.com>
2023-11-20 16:16:37 +08:00
..
datasets [Feat] support humaneval and mbpp pass@k (#598) 2023-11-16 21:22:06 +08:00
lagent [Feat] Support cibench (#538) 2023-11-07 19:11:44 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Feat] support humaneval and mbpp pass@k (#598) 2023-11-16 21:22:06 +08:00
multimodal [Feature]: To be compatible with the latest version of MiniGPT-4 (#539) 2023-11-04 09:50:36 +08:00
openicl [Feat] support humaneval and mbpp pass@k (#598) 2023-11-16 21:22:06 +08:00
partitioners [Sync] update (#517) 2023-10-27 20:31:22 +08:00
runners [Sync] update model configs (#574) 2023-11-13 15:15:34 +08:00
summarizers [Feature] Add multi-prompt generation demo (#568) 2023-11-20 16:16:37 +08:00
tasks [Feat] support humaneval and mbpp pass@k (#598) 2023-11-16 21:22:06 +08:00
utils [Feat] support humaneval and mbpp pass@k (#598) 2023-11-16 21:22:06 +08:00
__init__.py [Sync] Bump version to 0.1.8 (#576) 2023-11-13 16:00:38 +08:00
registry.py [Sync] update github token (#475) 2023-10-13 06:50:54 -05:00