Sunny-bot1 e45050cae3 [Feature] support top_k_top_p sampling (#2753) ...

* support top_k_top_p sampling

* fix

* add api param

* add api para

* fix

* fix

* fix

* fix

* fix

* fix

* fix

2025-07-09 20:58:58 -07:00

..

openai

[Feature] support top_k_top_p sampling (#2753)

2025-07-09 20:58:58 -07:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

api_server.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

chat_utils.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

engine_client.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

llm.py

[LLM] support multi node deploy (#2708)

2025-07-06 10:33:51 +08:00