FastDeploy

mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-04 16:22:57 +08:00

Files

zyfncg f677c032c0 [CudaGraph] [SOT] Support spliting static graph into piecewise graph with cuda_graph (#3478 )

* support spliting static graph into piecewise graph with cuda_graph

* Update fastdeploy/model_executor/graph_optimization/cudagraph_piecewise_backend.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix merge conflict

* fix bug

---------

Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

2025-08-29 16:28:01 +08:00

__init__.py

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cudagraph_piecewise_backend.py

[CudaGraph] [SOT] Support spliting static graph into piecewise graph with cuda_graph (#3478 )

2025-08-29 16:28:01 +08:00

decorator.py

[Executor] CUDAGraph support RL training (#3265 )

2025-08-25 20:59:30 +08:00

dynamic_dims_marker.py

[SOT] Mark dynamic dims by type annotations (#2771 )