Sunny-bot1 1107e08cd9 [Feature 2.0.2] support top_k_top_p sampling (#2789) ...

* support top_k_top_p sampling

* fix

* add api param

* add api para

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* fix

* change func name

2025-07-09 21:01:51 -07:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

args_utils.py

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

config.py

[Feature 2.0.2] support top_k_top_p sampling (#2789)

2025-07-09 21:01:51 -07:00

engine.py

[Feature 2.0.2] support top_k_top_p sampling (#2789)

2025-07-09 21:01:51 -07:00

expert_service.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

kv_cache_interface.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

request.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

resource_manager.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

sampling_params.py

[Feature 2.0.2] support top_k_top_p sampling (#2789)

2025-07-09 21:01:51 -07:00