ltd0924 4b14dca1d6 [LLM] delete fixed slots (#2893)

2025-07-17 19:19:54 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

args_utils.py

[LLM] Update Multinode Deployment (#2830)

2025-07-16 23:42:54 +08:00

config.py

[LLM] fix serval bugs (#2878)

2025-07-17 14:21:05 +08:00

engine.py

[LLM] fix serval bugs (#2878)

2025-07-17 14:21:05 +08:00

expert_service.py

[LLM] Update Multinode Deployment (#2830)

2025-07-16 23:42:54 +08:00

kv_cache_interface.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

request.py

[LLM] delete fixed slots (#2893)

2025-07-17 19:19:54 +08:00

resource_manager.py

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

sampling_params.py

fix topp default value (#2814)

2025-07-11 17:10:21 +08:00