Ryan b87e2c6184 [CUDAGraph]Add support for custom all-reduce operators under SOT mode (#4386)

2025-10-16 19:31:19 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cudagraph_piecewise_backend.py

[CUDAGraph]Add support for custom all-reduce operators under SOT mode (#4386)

2025-10-16 19:31:19 +08:00

decorator.py

[BugFix] Fix image_feature 0-Size causing insert failed (#4042)

2025-09-12 19:13:08 +08:00

dynamic_dims_marker.py

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

graph_optimization_backend.py

[Executor]CUDAGraph support Speculate Decode (#3769)

2025-10-09 21:18:29 +08:00

utils.py

[SOT] Add sot warmup (NVIDIA GPU Only) (#2929)

2025-07-22 21:36:14 +08:00