Commit Graph

2 Commits

Author SHA1 Message Date
RunningLeon
c54a5d3b0f
Support get_ppl for TurbomindModel (#878)
* update ppl for turbomindmodel

* update api_server

* rename config and set thread_safe for pytorch engine if possible
2024-03-06 11:44:19 +08:00
AllentDan
336d8d76ff
add turbomind restful api support (#693)
* add turbomind restful api support

* config

* top_p 0.8

* top_k = 1
2023-12-24 01:40:00 +08:00