OpenCompass/opencompass
Yi Ding 3f833186dc
[Feature] Support the reasoning from BaiLing LLM (#1541)
* [Feature] Support the reasoning from BaiLing LLM

This commit includes the access to BaiLing LLM and gets the reasoning.

* Add the api example

The example of evalute bailing api

* Revise the generation arguments

Based on current experiment, we update some generation arguments for better reasoning

* [fix] set the batch size

* Retry under flowcontrol of serverside

* add dependent package into requirement.txt

add dependent package retrying to clean up the pre-comment check.

* correct the file names and make the file copy

correct the file names.
copy the files under configs to opencompass

* fix the lint issue

---------

Co-authored-by: christopher.dy <christopher.dy@antgroup.com>
2024-09-26 16:49:52 +08:00
..
cli [Feature] Support import configs/models/summarizers from whl (#1376) 2024-08-01 00:42:48 +08:00
configs [Feature] Support the reasoning from BaiLing LLM (#1541) 2024-09-26 16:49:52 +08:00
datasets [Feature] Update MathBench & WikiBench for FullBench (#1521) 2024-09-18 14:35:30 +08:00
lagent Update CIBench (#1089) 2024-04-26 18:46:02 +08:00
metrics [Feat] Support multi-modal evaluation on MME benchmark. (#197) 2023-08-21 15:53:20 +08:00
models [Feature] Support the reasoning from BaiLing LLM (#1541) 2024-09-26 16:49:52 +08:00
openicl [Feature] Support verbose for OpenAI API (#1546) 2024-09-20 17:12:52 +08:00
partitioners [Fix] fix duplicate error in partitioner (#1552) 2024-09-23 19:45:21 +08:00
runners [Feature] Add dlc sleep time (#1562) 2024-09-25 11:53:48 +08:00
summarizers [CI] add a common summarizer for qabench summarizer (#1545) 2024-09-25 13:40:47 +08:00
tasks [Feature] Add model postprocess function (#1484) 2024-09-05 21:10:29 +08:00
utils [Feature] Add custom model postprocess function (#1519) 2024-09-18 14:40:51 +08:00
__init__.py [Bump] Bump version to 0.3.2.post1 2024-09-06 19:09:30 +08:00
registry.py [Deperecate] Remove multi-modal related stuff (#1072) 2024-04-26 21:20:14 +08:00