Ryan f42ed6d5f2 [Graph Optimization] Add dy_runnable and introduce cudagraph_switch_threshold for cudagraph mode switching (#4578) ...

* add new branch for sot

* reorder

* fix batch bug

2025-10-24 18:36:52 +08:00

..

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cudagraph_piecewise_backend.py

[CUDAGraph]Add support for custom all-reduce operators under SOT mode (#4386)

2025-10-16 19:31:19 +08:00

decorator.py

[BugFix] Fix image_feature 0-Size causing insert failed (#4042)

2025-09-12 19:13:08 +08:00

dynamic_dims_marker.py

[SOT] Mark dynamic dims by type annotations (#2771)

2025-07-22 00:23:52 -07:00

graph_optimization_backend.py

[Graph Optimization] Add dy_runnable and introduce cudagraph_switch_threshold for cudagraph mode switching (#4578)

2025-10-24 18:36:52 +08:00

utils.py

[Iluvatar GPU] fix ci error caused by rebuild_padding param and cuda graph (#4504)

2025-10-21 21:41:41 +08:00