Yuanle Liu 7ac25935c7 [Optimization] default compile rdma, reduce cudagraph buffer size in mm, fix some config bug (#5121) ...

* default compile rdma, reduce cudagraph buffer size in mm, fix some config logic

* update

* update

* fix bug

* enhance rdma compile

* fix

2025-11-20 17:19:47 +08:00

..

sched

[Scheduler] Support chunk prefill for video input (#5107)

2025-11-20 16:29:13 +08:00

__init__.py

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

args_utils.py

[Optimization] default compile rdma, reduce cudagraph buffer size in mm, fix some config bug (#5121)

2025-11-20 17:19:47 +08:00

async_llm.py

[PD Disaggregation] remove splitwise deployment on single node and refine the code (#4891)

2025-11-14 09:56:53 +08:00

common_engine.py

[Feature] support async download features (#5003)

2025-11-19 22:23:36 +08:00

engine.py

[Feature][OP] Append Attn Support CUDA-PDL (#5072)

2025-11-17 20:47:33 +08:00

expert_service.py

[Optimize] Support and robust for tpN for PD (#4595)

2025-11-03 15:38:31 +08:00

kv_cache_interface.py

bug: fix list to List (#4818)

2025-11-06 16:13:12 +08:00

pooling_params.py

[feature] support reward api (#4518)

2025-10-29 00:20:28 +08:00

request.py

[Feature] support async download features (#5003)

2025-11-19 22:23:36 +08:00

resource_manager.py

[fix] fix requests & block metrics (#4404)

2025-10-15 11:49:24 +08:00

sampling_params.py

[Logprobs]Support prompt_logprobs and max_logprobs (#4897)

2025-11-12 19:29:48 +08:00

tasks.py

[feature] support reward api (#4518)

2025-10-29 00:20:28 +08:00