Commit Graph

262 Commits

Author SHA1 Message Date
Songyang Zhang
239c2a346e
[Feature] Add support for MiniMax API (#548)
* update requirement

* update requirement

* update with minimax

* update api model

* Update readme

* fix error

---------

Co-authored-by: zhangsongyang <zhangsongyang@pjlab.org.cn>
2023-11-06 21:57:32 +08:00
Hubert
1ccdfaa623
[Feat] support xunfei api (#547) 2023-11-06 19:29:26 +08:00
Songyang Zhang
cbf412f68a
update readme (#540) 2023-11-06 16:40:09 +08:00
Yuan Liu
6e31520128
[Feature]: To be compatible with the latest version of MiniGPT-4 (#539)
* [Feature]: To be compatible with the latest version of MiniGPT-4

* [Feature]: User try and except

Co-authored-by: Fengzhe Zhou <zfz-960727@163.com>

* [Fix]: Fix lint

---------

Co-authored-by: bensenliu <bensenliu@tencent.com>
Co-authored-by: Fengzhe Zhou <zfz-960727@163.com>
2023-11-04 09:50:36 +08:00
bittersweet1999
f25a980043
[fFeat] Add an opensource dataset Tabmwp (#505)
* TabMWP

* TabMWP

* fixed

* fixed

* fixed

* done

* done

* done

---------

Co-authored-by: caomaosong <caomaosong@pjlab.org.cn>
2023-11-03 11:15:46 +08:00
Songyang Zhang
987a711232
[Doc] Update README and FAQ (#535)
* update readme

* update readme and faq
2023-11-02 15:16:37 +08:00
Surav Shrestha
e5ae86221c
docs: fix typos in markdown files (#530)
* fix typos in configs/multimodal/llava/README.md

* fix typos in configs/multimodal/minigpt_4/README.md
2023-11-01 16:16:16 +08:00
Himanshu Kumar Mahto
b562a13619
Update README.md (#531) 2023-11-01 10:17:18 +08:00
ayushrakesh
8cdd9f8e16
Update README.md (#523) 2023-10-31 10:45:42 +08:00
Hubert
b9270c3a60
[Fix] Fix local debug mode not restrict the resources (#522)
* [Fix] fix local debug mode not restrict the resources

* minor fix
2023-10-30 18:13:43 +08:00
Qing
229a65f305
[Fix] Fix typo in WSC prompt (#520)
Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
2023-10-30 12:16:26 +08:00
Qing
e2355a2ede
[Feature] Add multi model viz (#509)
* add viz_multi_model.py tool

* Modify the viz_multi_model.py script according to the review

* highlight multiple optimal scores

---------

Co-authored-by: wq.chu <wq.chu@tianrang-inc.com>
Co-authored-by: Leymore <zfz-960727@163.com>
2023-10-30 12:11:33 +08:00
Fengzhe Zhou
6a398d171c
Bump version to 0.1.7 (#518) 2023-10-27 20:32:27 +08:00
Fengzhe Zhou
dbb20b8270
[Sync] update (#517) 2023-10-27 20:31:22 +08:00
Hubert
6f07af3039
[Feat] Support local runner for windows (#515) 2023-10-27 17:16:22 +08:00
Fengzhe Zhou
df07391ed8
[Fix] Enforce do_sample=False in HF model (#506)
* update hf model wrapper

* patch llama

---------

Co-authored-by: bot <bot@bot.com>
2023-10-27 16:54:19 +08:00
Wei Jueqi
b62842335d
[Doc] Update Subjective docs (#510)
* rename

* add en subdoc

* fix name

* fix writing

* update

---------

Co-authored-by: Leymore <zfz-960727@163.com>
2023-10-27 16:27:24 +08:00
Fengzhe Zhou
e3d4901bed
[Feat] Add _set_model_kwargs_torch_dtype for HF model (#507)
* add _set_model_kwargs_torch_dtype for hf models

* add logger
2023-10-27 11:45:41 +08:00
Fengzhe Zhou
6405cd2db5
use example summarizer by default (#508) 2023-10-27 11:45:29 +08:00
Fengzhe Zhou
46e7ede938
update owner (#504)
Co-authored-by: bot <bot@bot.com>
2023-10-26 14:35:53 +08:00
Hubert
b3f5d9e421
[Feat] support math/gms8k agent config (#494)
* support math agent

* support gsm8k agent

* support gsm8k agent

* minor fix

* minor fix

* minor fix

* Update configs/eval_codeagent.py
2023-10-25 23:05:15 +08:00
Hubert
ac3a2c4501
[Feat] local api speed up with fixed concurrent users (#497)
* [Feat] local api speed up

* fix lint

* fix lint

* minor fix

* add example api
2023-10-25 21:12:20 +08:00
Hubert
44c8d6cc60
[Docs] update invalid link in docs (#499) 2023-10-25 13:15:42 +08:00
Sakshi Umredkar
0809a5632e
Update README.md (#496) 2023-10-23 10:40:18 +08:00
Leymore
4dd9a3fc10
[Sync] sync with internal codes 20231019 (#488) 2023-10-18 23:37:35 -05:00
liushz
2737249f31
[Feature] Add mathbench dataset and circular evaluator (#408)
* add_mathbench

* update mathbench

* support non circular eval dataset

---------

Co-authored-by: liuhongwei <liuhongwei@pjlab.org.cn>
Co-authored-by: yingfhu <yingfhu@gmail.com>
2023-10-18 04:08:31 -05:00
Leymore
fccfcb6f5b
fix summary default (#483) 2023-10-17 11:32:38 +08:00
Leymore
6317da08b3
Bump version to 0.1.6 (#478) 2023-10-13 06:54:51 -05:00
Leymore
7d9e386821
[Fix] Split if and only if complete eos string shows up (#477) 2023-10-13 06:52:20 -05:00
Leymore
861942ab1b
[Feature] Add lawbench (#460)
* add lawbench

* update requirements

* update
2023-10-13 06:51:36 -05:00
Leymore
fbf5089c40
[Sync] update github token (#475) 2023-10-13 06:50:54 -05:00
Leymore
362c33dff4
fix jieba rouge (#467) 2023-10-12 10:25:19 +08:00
Leymore
d7ff933a73
[Fix] Use jieba rouge in lcsts (#459)
* use jieba rouge in lcsts

* use rouge_chinese
2023-10-09 10:10:33 +08:00
Tong Gao
c903e7f662
[Docs] Fix dead links in readme (#455) 2023-10-07 00:14:29 -05:00
Tong Gao
119bfd1569
[Refactor] Move fix_id_list to Retriever (#442)
* [Refactor] Move fix_id_list to Retriever

* update

* move to base

* fix
2023-10-07 12:53:41 +08:00
Tong Gao
767c12a660
[Docs] update get_started (#435)
* [Docs] update get_started

* [Docs] Refactor get_started

* update

* add zh FAQ

* add cn doc

* update

* fix dead links

---------

Co-authored-by: Leymore <zfz-960727@163.com>
2023-10-07 11:49:40 +08:00
Lyu Han
6738247142
Integrate turbomind inference via its RPC API instead of its python API (#414)
* support tis

* integrate turbomind inference via its RPC API instead of its python API

* update guide

* update ip address spec

* update according to reviewer's comments
2023-10-07 10:27:48 +08:00
Leymore
9db5652638
[Feature] re-implement ceval load dataset (#446) 2023-09-27 21:18:48 +08:00
Hubert
d9f3e88dfe
[Fix] fix clp potential error and support bs>1 (#439)
* [Fix] fix clp potential error and support bs>1

* [Fix] fix clp potential error and support bs>1

* minor fix

* minor fix
2023-09-27 16:32:57 +08:00
philipwangOvO
3bb3d330eb
[Sync] Update LongEval (#443) 2023-09-27 16:32:40 +08:00
Leymore
2bb7beeca3
[Fix] use eval field check (#441) 2023-09-27 15:11:14 +08:00
Leymore
d6261e109d
[Doc] Update dataset list (#437)
* add new dataset list

* add new dataset list

* add new dataset list

* update

* update

* update readme

---------

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2023-09-27 15:02:09 +08:00
Kevin Wang
dc1b82c346
[SIG] add GLUE_MRPC dataset (#440) 2023-09-27 11:44:54 +08:00
Kevin Wang
14fdecfecc
[Dataset] add GLUE QQP dataset (#438) 2023-09-27 11:36:43 +08:00
Kevin Wang
d8354fe5d8
[SIG] add GLUE_CoLA dataset (#406)
* [Dataset] add GLUE_CoLA dataset

* [update] use HFDataset to load glue/cola dataset

* update

---------

Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2023-09-27 11:30:44 +08:00
Kevin Wang
012546666b
[SIG] add WikiText-2&103 (#397)
* fix conflict

* add eval_cfg
2023-09-26 14:31:15 +08:00
Tong Gao
9b21613d17
Bump version to 0.1.5 (#432) 2023-09-22 19:17:23 +08:00
chenbohua3
b2926eac8f
[Feature] support customize config path (#423)
* support customize config path

* support customize config path

* support customize config path
2023-09-22 19:12:02 +08:00
Yixiao Fang
524579b5af
[Docs] Add multimodal docs (#334)
* add multimodal docs

* fix lint

---------

Co-authored-by: Tong Gao <gaotongxiao@gmail.com>
2023-09-22 18:58:29 +08:00
liushz
c5224c2a91
[Feature] Add kaoshi dataset (#392)
* Add ToT method

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Update ToT

* Add Koashi

* Update Kaoshi

* Update Kaoshi

* Update kaoshi

* Update kaoshi

* Update Kaoshi

* Update Kaoshi

* Update Kaoshi

* Update Kaoshi

* update Kaoshi

* update

* update

* fix

---------
Co-authored-by: gaotongxiao <gaotongxiao@gmail.com>
2023-09-22 18:46:33 +08:00