Commit Graph

4 Commits

Author SHA1 Message Date
Sunny-bot1
4025ea7e5b [FIX 2.0.2] Topk topp sampling fix (#2805)
* fix topk-topp

* fix
2025-07-10 06:15:03 -07:00
Sunny-bot1
1107e08cd9 [Feature 2.0.2] support top_k_top_p sampling (#2789)
* support top_k_top_p sampling

* fix

* add api param

* add api para

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* change func name
2025-07-09 21:01:51 -07:00
Jiang-Jia-Jun
92c2cfa2e7 Sync v2.0 version of code to github repo 2025-06-29 23:29:37 +00:00
jiangjiajun
684703fd72 [LLM] First commit the llm deployment code 2025-06-09 19:20:15 +08:00