apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-05 08:37:06 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
Files
d339df2e90ef61f39e46249719bb3398cbc44a75
FastDeploy/custom_ops/gpu_ops/append_attn
History
xiaoxiaohehe001 70c75798a7
Some checks failed
CE Compile Job / ce_job_pre_check (push) Has been cancelled
Details
CE Compile Job / print_ce_job_pre_check_outputs (push) Has been cancelled
Details
CE Compile Job / FD-Clone-Linux (push) Has been cancelled
Details
CE Compile Job / Show Code Archive Output (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8090 (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8689 (push) Has been cancelled
Details
CE Compile Job / CE_UPLOAD (push) Has been cancelled
Details
Deploy GitHub Pages / deploy (push) Has been cancelled
Details
[NewFeatures] support noex rope3d (#3542) 
* [NewFeatures] support noex rope3d

* [NewFeatures] support noex rope3d encoder
2025-08-26 11:44:57 +08:00
..
template_instantiation
support qk norm (#3145)
2025-08-05 16:46:14 +08:00
append_attention_c4_impl.cuh
[Feature][SpeculativeDecoding]Support tree-attention (#3514)
2025-08-22 13:36:41 +08:00
append_attention_c8_impl.cuh
[Feature][SpeculativeDecoding]Support tree-attention (#3514)
2025-08-22 13:36:41 +08:00
append_attention_c16_impl.cuh
[Feature][SpeculativeDecoding]Support tree-attention (#3514)
2025-08-22 13:36:41 +08:00
append_attention_func.cuh
[Feature][SpeculativeDecoding]Support tree-attention (#3514)
2025-08-22 13:36:41 +08:00
append_attention_kernel.h
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
decode_attention_func.cuh
[Sync] Update to latest code (#2679)
2025-07-03 15:43:53 +08:00
decode_attention_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
decoder_write_cache_with_rope_impl.cuh
[NewFeatures] support noex rope3d (#3542)
2025-08-26 11:44:57 +08:00
decoder_write_cache_with_rope_kernel.cu
[NewFeatures] support noex rope3d (#3542)
2025-08-26 11:44:57 +08:00
decoder_write_cache_with_rope_kernel.h
support qk norm (#3145)
2025-08-05 16:46:14 +08:00
encoder_write_cache_with_rope_impl.cuh
[NewFeatures] support noex rope3d (#3542)
2025-08-26 11:44:57 +08:00
encoder_write_cache_with_rope_kernel.h
support qk norm (#3145)
2025-08-05 16:46:14 +08:00
get_block_shape_and_split_kv_block.cu
[Excutor] Increase buffer size to prevent address corruption; add forward metadata debug tool (#3404)
2025-08-18 16:14:09 +08:00
gqa_rope_write_cache.cu
fix c4 prompt_cache
2025-07-28 14:31:37 +08:00
mem_util.cuh
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
mla_cache_kernel.cu
[Feature] DeepseekV3 use pd_build_static_op (#2948)
2025-07-22 15:03:41 +08:00
mla_cache_kernel.cuh
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
mma_tensor_op.cuh
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
multi_head_latent_attention_kernel.h
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
pre_cache_len_concat.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_write_cache_with_rope_impl.cuh
support c4 attn && fix cache
2025-07-24 12:00:52 +08:00
speculate_write_cache_with_rope_kernel.cu
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
speculate_write_cache_with_rope_kernel.h
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
utils.cuh
make append_attn supports mask_offset (#3138)
2025-08-14 03:40:55 -07:00