Junnan Liu
|
499302857f
|
[Fix] Fix Local Runner Params Save Path (#1768)
* update local runner params save dir
* fix remove
* fix directory remove
* Fix *_params.py by uuid4
|
2024-12-19 16:07:34 +08:00 |
|
Songyang Zhang
|
0d8df541bc
|
[Update] Update O1-style Benchmark and Prompts (#1742)
* Update JuderBench
* Support O1-style Prompts
* Update Code
* Update OpenAI
* Update BigCodeBench
* Update BigCodeBench
* Update BigCodeBench
* Update BigCodeBench
* Update BigCodeBench
* Update
* Update
* Update
* Update
|
2024-12-09 13:48:56 +08:00 |
|
Songyang Zhang
|
fb43dd1906
|
[Update] Update Skywork/Qwen-QwQ (#1728)
* Update JuderBench
* Support O1-style Prompts
* Update Code
* Update OpenAI
* Update BigCodeBench
* Update BigCodeBench
* Update BigCodeBench
* Update BigCodeBench
* Update BigCodeBench
* Update
|
2024-12-05 19:30:43 +08:00 |
|
Linchen Xiao
|
80e3b9ef37
|
[Update] Add math prm 800k (#1708)
|
2024-11-21 21:29:43 +08:00 |
|
Linchen Xiao
|
500fb1032a
|
[Update] Update configurations (#1704)
|
2024-11-21 16:51:18 +08:00 |
|
Linchen Xiao
|
df57c08ccf
|
[Feature] Update Models, Summarizers (#1600)
|
2024-10-29 18:37:15 +08:00 |
|
Songyang Zhang
|
e8437db98f
|
[Feature] Update BailingLM/OpenAI verbose (#1568)
* [Feature] 1. Update CoreBench Base\n 2. Fix lint issue in BalingAPI
* Update
* [Feature] Update API
* Update
|
2024-09-27 11:15:25 +08:00 |
|
Songyang Zhang
|
ee058e25b2
|
[Feature] Support verbose for OpenAI API (#1546)
|
2024-09-20 17:12:52 +08:00 |
|
Songyang Zhang
|
be460fbb21
|
[Feature] Support OpenAI O1 models (#1539)
* [Feature] Support OpenAI O1 models
* Update README.md
---------
Co-authored-by: liushz <qq1791167085@163.com>
|
2024-09-18 22:41:17 +08:00 |
|
Alexander Lam
|
8b39225259
|
[Feature] Added extra_body support for OpenAISDK; Added support for proxy URL when connecting to OpenAI's API. (#1467)
* fix lint issues
* fix lint issues
|
2024-08-29 00:43:43 +08:00 |
|
Guoli Yin
|
a488b9b4f5
|
[Feature] Make OPENAI_API_BASE compatible with openai default env (#1461)
* Make OPENAI_API_BASE compatible with openai default env
* Make OPENAI_API_BASE compatible with openai default env
---------
Co-authored-by: Guoli Yin <gyin@icloud.com>
|
2024-08-28 23:14:41 +08:00 |
|
seetimee
|
ac093fce53
|
[Update] Update openai_api.py (#1438)
Most models' token limits are above 32k. It will fix long context dataset test bug of skiping some data.
|
2024-08-21 18:57:49 +08:00 |
|
liushz
|
e076dc5acf
|
[Fix] Fix openai api tiktoken bug for api server (#1433)
* Fix openai api tiktoken
* Fix openai api tiktoken
---------
Co-authored-by: liushz <liuhongwei@pjlab.rog.cn>
|
2024-08-20 22:02:14 +08:00 |
|
Songyang Zhang
|
c81329b548
|
[Fix] Fix Slurm ENV (#1392)
1. Support Slurm Cluster
2. Support automatic data download
3. Update InternLM2.5-1.8B/20B-Chat
|
2024-08-06 01:35:20 +08:00 |
|
Songyang Zhang
|
c09fc79ba8
|
[Feature] Support OpenAI ChatCompletion (#1389)
* [Feature] Support import configs/models/summarizers from whl
* Update
* Update openai sdk
* Update
* Update gemma
|
2024-08-01 19:10:13 +08:00 |
|
Songyang Zhang
|
46cc7894e1
|
[Feature] Support import configs/models/summarizers from whl (#1376)
* [Feature] Support import configs/models/summarizers from whl
* Update LCBench configs
* Update
* Update
* Update
* Update
* update
* Update
* Update
* Update
* Update
* Update
|
2024-08-01 00:42:48 +08:00 |
|
heya5
|
73aa55af6d
|
[Fix] Support HF models deployed with an OpenAI-compatible API. (#1352)
* Support HF models deployed with an OpenAI-compatible API.
* resolve lint issue
* add extra_body arguments
There are many other arguments when using openi-compatiable API like this: https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#extra-parameters-for-chat-api
* fix linting issue
* fix yapf linting issue
|
2024-07-25 18:38:23 +08:00 |
|
Fengzhe Zhou
|
a32f21a356
|
[Sync] Sync with internal codes 2024.06.28 (#1279)
|
2024-06-28 14:16:34 +08:00 |
|
Fengzhe Zhou
|
2954913d9b
|
[Sync] bump version (#1204)
|
2024-05-28 23:09:59 +08:00 |
|
bittersweet1999
|
88c14d3d04
|
add support for lmdeploy api judge (#1193)
|
2024-05-24 23:28:56 +08:00 |
|
Fengzhe Zhou
|
8c85edd1cd
|
[Sync] deprecate old mbpps (#1064)
|
2024-04-19 20:49:46 +08:00 |
|
Fengzhe Zhou
|
7a41951dda
|
[Fix] logger.error -> logger.debug in OpenAI wrapper (#1050)
* logger.error -> logger.info in OpenAI
* logger.info -> logger.debug in OpenAI
|
2024-04-15 21:08:13 +08:00 |
|
Fengzhe Zhou
|
b39f501563
|
[Sync] update taco (#1030)
|
2024-04-09 17:50:23 +08:00 |
|
bittersweet1999
|
02e7eec911
|
[Feature] Support AlpacaEval_V2 (#1006)
* support alpacaeval_v2
* support alpacaeval
* update docs
* update docs
|
2024-03-28 16:49:04 +08:00 |
|
Fengzhe Zhou
|
bdd85358cc
|
[Sync] update 20240308 (#953)
|
2024-03-11 22:34:19 +08:00 |
|
Fengzhe Zhou
|
b03d5dc531
|
[Sync] Sync Internal (#941)
|
2024-03-04 14:42:36 +08:00 |
|
Fengzhe Zhou
|
d34ba11106
|
[Sync] Merge branch 'dev' into zfz/update-keyset-demo (#876)
|
2024-02-05 23:29:10 +08:00 |
|
bittersweet1999
|
5679edb490
|
add temperature in alles (#787)
|
2024-01-11 03:57:24 +00:00 |
|
Hubert
|
eda72e756e
|
[Fix] minor fix openai (#711)
|
2023-12-18 15:45:31 +08:00 |
|
Songyang Zhang
|
637628a70f
|
[Doc] Update Doc for Alignbench (#707)
* update alignmentbench
* update alignmentbench
* update doc
* update
* update
|
2023-12-15 15:07:25 +08:00 |
|
Songyang Zhang
|
bfe4aa2af5
|
[Fix] Update alignmentbench (#704)
* update alignmentbench
* update alignmentbench
* update alignmentbench
|
2023-12-14 18:24:21 +08:00 |
|
Hubert
|
e78857ac36
|
[Sync] minor test (#683)
|
2023-12-11 17:42:53 +08:00 |
|
philipwangOvO
|
3b29aaee2b
|
[Fix] bin_trim (#237)
Co-authored-by: wangchonghua <wangchonghua@pjlab.org.cn>
|
2023-08-21 15:44:49 +08:00 |
|
philipwangOvO
|
655a807f4b
|
[Dataset] LongBench (#236)
Co-authored-by: wangchonghua <wangchonghua@pjlab.org.cn>
|
2023-08-21 14:15:20 +08:00 |
|
Zaida Zhou
|
f256abffd3
|
[Enhancement] Skip invalid keys to avoid requesting API (#184)
* Skip invalid keys to avoid requesting API
* get expected key
* print warning info
|
2023-08-10 18:41:43 +08:00 |
|
Haodong Duan
|
d5d4f47371
|
[API] Refine OpenAI (#175)
|
2023-08-09 12:38:57 +08:00 |
|
Zaida Zhou
|
af436f5951
|
[Feature] Calculate max_out_len without hard code for OpenAI model (#158)
* calulate max_out_len without hard code
* set default value
* update configs
* Update configs/eval_gpt3.5.py
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>
---------
Co-authored-by: Tong Gao <gaotongxiao@gmail.com>
|
2023-08-08 15:16:56 +08:00 |
|
Tong Gao
|
bbdedc6c95
|
[Enhancement] Optimize OpenAI models (#128)
* [Feature] Enhance OpenAI API, add example config for GPT evaluation
|
2023-08-03 14:55:16 +08:00 |
|
Haodong Duan
|
46c9645753
|
[Feature] Allow explicitly setting the temperature for API model (#121)
* allow explicitly setting the temperature
* update
|
2023-07-28 11:28:15 +08:00 |
|
Tong Gao
|
7ee5a86fee
|
[Feature] Enhance OpenAI API, add example config for GPT evaluation (#53)
* [Feature] Enhance OpenAI API, add example config for GPT evaluation
* fix
|
2023-07-12 16:43:46 +08:00 |
|
Leymore
|
c94cc94348
|
Add release contribution
|
2023-07-05 03:15:31 +00:00 |
|