OpenCompass/opencompass
Jingming dd4318f6ab
[Feature] enhance the ability of humaneval_postprocess (#676)
* [Feature] enhance the ability of humaneval_postprocess

* refactor

* [Feature] Keep the old version of the function and realize the new function in humaneval_postprocess_v2.

* Update opencompass/datasets/humaneval.py

---------

Co-authored-by: Leymore <zfz-960727@163.com>
Co-authored-by: Hubert <42952108+yingfhu@users.noreply.github.com>
2023-12-11 14:39:56 +08:00
..
datasets [Feature] enhance the ability of humaneval_postprocess (#676) 2023-12-11 14:39:56 +08:00
lagent [Feature] Support chat style inferencer. (#643) 2023-11-30 14:00:06 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Enhancement] Update API Interface and Mixtral (#681) 2023-12-10 13:29:26 +08:00
multimodal [Feature]: To be compatible with the latest version of MiniGPT-4 (#539) 2023-11-04 09:50:36 +08:00
openicl [Feature] Add Data Contamination Analysis (#639) 2023-12-08 10:00:11 +08:00
partitioners [Sync] update (#517) 2023-10-27 20:31:22 +08:00
runners [Sync] Fix cmnli, fix vicuna meta template, fix longbench postprocess and other minor fixes (#625) 2023-11-23 14:05:59 +08:00
summarizers [Fix] fix bug on standart_deviation summarizer (#675) 2023-12-08 13:38:07 +08:00
tasks [Bug] fix icl eval with nested list (#632) 2023-11-24 13:43:26 +08:00
utils [Feat] support zhipu post process (#642) 2023-11-27 19:57:36 +08:00
__init__.py [Sync] Bump version to 0.1.9 (#644) 2023-11-28 11:42:43 +08:00
registry.py [Sync] update github token (#475) 2023-10-13 06:50:54 -05:00