OpenCompass/opencompass
Wang Xingjin 048d41a1c4
add vllm get_ppl (#1003)
* add vllm get_ppl

* add vllm get_ppl

* format

---------

Co-authored-by: xingjin.wang <xingjin.wang@mihoyo.com>
Co-authored-by: Leymore <zfz-960727@163.com>
2024-04-26 21:31:56 +08:00
..
cli [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00
datasets [Feature] Add gpqa prompt from simple_evals, openai (#1080) 2024-04-26 20:13:00 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models add vllm get_ppl (#1003) 2024-04-26 21:31:56 +08:00
openicl [Feature] Support Math evaluation via judgemodel (#1094) 2024-04-26 14:56:23 +08:00
partitioners [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00
runners [Fix] Fix sequential runner (#1070) 2024-04-23 11:31:10 +08:00
summarizers Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
tasks [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00
utils [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00
__init__.py [Sync] Bump version to 0.2.4 (#1052) 2024-04-16 18:09:46 +08:00
registry.py [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00