zyfncg f677c032c0 [CudaGraph] [SOT] Support spliting static graph into piecewise graph with cuda_graph (#3478) ...

* support spliting static graph into piecewise graph with cuda_graph

* Update fastdeploy/model_executor/graph_optimization/cudagraph_piecewise_backend.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* fix merge conflict

* fix bug

---------

Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

2025-08-29 16:28:01 +08:00

..

cache_manager

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

demo

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

distributed

Supports DP+TP+EP hybrid parallel deployment strategy (#3489)

2025-08-26 00:04:01 -07:00

engine

add dtype int32 (#3692)

2025-08-29 14:56:35 +08:00

entrypoints

[feat] completion api supports passing input token ids in either prompt or prompt_token_ids (#3311)

2025-08-29 14:19:42 +08:00

input

[feat] completion api supports passing input token ids in either prompt or prompt_token_ids (#3311)

2025-08-29 14:19:42 +08:00

inter_communicator

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

logger

add error log to file (#3431)

2025-08-20 09:52:34 +08:00

metrics

[Trace]add trace when fd start (#3174)

2025-08-05 21:18:27 +08:00

model_executor

[CudaGraph] [SOT] Support spliting static graph into piecewise graph with cuda_graph (#3478)

2025-08-29 16:28:01 +08:00

multimodal

fix MultimodalRegistry (#3699)

2025-08-29 11:01:30 +08:00

output

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

platforms

Revert "[Feature] block sparse attention (#3209)" (#3647)

2025-08-27 17:35:04 +08:00

plugins

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

reasoning

[Feature] add tool parser (#3483)

2025-08-21 17:25:44 +08:00

rl

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00

scheduler

add error traceback info (#3419)

2025-08-19 19:32:04 +08:00

spec_decode

fix deepcopy(tp_group) in spec (#3648)

2025-08-29 16:08:21 +08:00

splitwise

[NewFeature]Support dp multi api server && Fix some bug in mixed ep && merge develop (#3598)

2025-08-26 19:59:02 +08:00

worker

add dtype int32 (#3692)

2025-08-29 14:56:35 +08:00

__init__.py

[BugFix] Fix default log level of paddleformers (#3376)

2025-08-14 11:36:24 +08:00

config.py

[BugFix]fix dp&ep&tp and muti node infer (#3629)

2025-08-28 19:09:10 +08:00

envs.py

MoE Default use triton's blockwise fp8 in TP Case (#3678)

2025-08-29 11:07:30 +08:00

import_ops.py

fix import error (#2944)

2025-07-22 14:06:01 +08:00

stop.sh

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

test.yaml

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

utils.py

add input_processor plugin (#3657)

2025-08-28 22:53:57 +08:00