Yuan Xiaolan 7ce00e597c support qk norm (#3145)

2025-08-05 16:46:14 +08:00

..

append_attention_c4_bfloat16_bfloat16_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c4_bfloat16_fp8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c4_bfloat16_int8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c4_float16_float16_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c4_float16_fp8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c4_float16_int8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c8_bfloat16_bfloat16_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c8_bfloat16_fp8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c8_bfloat16_int8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c8_float16_float16_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c8_float16_fp8_kerne.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c8_float16_int8_kerne.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c16_bfloat16_bfloat16_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c16_bfloat16_fp8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c16_bfloat16_int8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c16_float16_float16_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c16_float16_fp8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

append_attention_c16_float16_int8_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

encoder_write_cache_with_rope_bfloat16_bfloat16_kernel.cu

support qk norm (#3145)

2025-08-05 16:46:14 +08:00

encoder_write_cache_with_rope_bfloat16_int_kernel.cu

support qk norm (#3145)

2025-08-05 16:46:14 +08:00

encoder_write_cache_with_rope_float16_float16_kernel.cu

support qk norm (#3145)

2025-08-05 16:46:14 +08:00

encoder_write_cache_with_rope_float16_int_kernel.cu

support qk norm (#3145)

2025-08-05 16:46:14 +08:00