FastDeploy

mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-09-26 20:41:53 +08:00

Files

freeliuzc 2f473ba966 [Feature][MTP]Support MTP for rl-model (#4009 )

* qk norm for speculate decode C16

* support mtp in v1_scheduler mode

* support mtp rope_3d

* support mtp features

* add unit test && del some log

---------

Co-authored-by: yuanxiaolan <yuanxiaolan01@baidu.com>
Co-authored-by: xiaoxiaohehe001 <hiteezsf@163.com>

2025-09-10 13:34:37 +08:00

cpu_ops

[Code Simplification] remove cum_offsets (#3410 )

2025-08-18 20:21:25 +08:00

gpu_ops

[Feature][MTP]Support MTP for rl-model (#4009 )

2025-09-10 13:34:37 +08:00

iluvatar_ops

[Iluvatar GPU] Optimze attention and moe performance (#3234 )

2025-08-08 10:51:24 +08:00

utils

【Fix bug] w4afp8 的nblock固定为256，并且fa3的append attn 增加mask参数 (#3771 ) (#3835 )