apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-04 08:16:42 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
Files
e2b68b33c97fc034e939c2e7f7d3b793ee4af8ff
FastDeploy/custom_ops/gpu_ops/append_attn/template_instantiation
History
Yuan Xiaolan 25aa2d94aa cp dynamic Cfp8 (#4120) 
* supports dynamic Cfp8

* add unittest

* fix dynamic Cfp8 computing error

* fix Cfp8 for RL load

---------

Co-authored-by: carryyu <569782149@qq.com>
2025-09-17 11:55:47 +08:00
..
append_attention_c4_bfloat16_bfloat16_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c4_bfloat16_fp8_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c4_bfloat16_int8_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c4_float16_float16_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c4_float16_fp8_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c4_float16_int8_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c8_bfloat16_bfloat16_kernel.cu
cp dynamic Cfp8 (#4120)
2025-09-17 11:55:47 +08:00
append_attention_c8_bfloat16_fp8_kernel.cu
cp dynamic Cfp8 (#4120)
2025-09-17 11:55:47 +08:00
append_attention_c8_bfloat16_int8_kernel.cu
cp dynamic Cfp8 (#4120)
2025-09-17 11:55:47 +08:00
append_attention_c8_float16_float16_kernel.cu
cp dynamic Cfp8 (#4120)
2025-09-17 11:55:47 +08:00
append_attention_c8_float16_fp8_kerne.cu
cp dynamic Cfp8 (#4120)
2025-09-17 11:55:47 +08:00
append_attention_c8_float16_int8_kerne.cu
cp dynamic Cfp8 (#4120)
2025-09-17 11:55:47 +08:00
append_attention_c16_bfloat16_bfloat16_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c16_bfloat16_fp8_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c16_bfloat16_int8_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c16_float16_float16_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c16_float16_fp8_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
append_attention_c16_float16_int8_kernel.cu
[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)
2025-07-17 18:41:31 +08:00
encoder_write_cache_with_rope_bfloat16_bfloat16_kernel.cu
support qk norm (#3145)
2025-08-05 16:46:14 +08:00
encoder_write_cache_with_rope_bfloat16_int_kernel.cu
support qk norm (#3145)
2025-08-05 16:46:14 +08:00
encoder_write_cache_with_rope_float16_float16_kernel.cu
support qk norm (#3145)
2025-08-05 16:46:14 +08:00
encoder_write_cache_with_rope_float16_int_kernel.cu
support qk norm (#3145)
2025-08-05 16:46:14 +08:00