lzy c71a44c7e5 supports mtp split_kv_attn (#5343)

2025-12-03 12:40:16 +08:00

..

template_instantiation

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

append_attention_c4_impl.cuh

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00

append_attention_c8_impl.cuh

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00

append_attention_c16_impl.cuh

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00

append_attention_func.cuh

supports mtp split_kv_attn (#5343)

2025-12-03 12:40:16 +08:00

append_attention_kernel.h

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00

decode_attention_func.cuh

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

decoder_mla_attention_kernel.cu

【Hackathon 9th No.86】autogen MoeFastHardamardImplWrapper template_instantiation (#4592)

2025-10-30 10:28:36 +08:00

decoder_mla_attention_kernel.h

【Hackathon 9th No.86】autogen MoeFastHardamardImplWrapper template_instantiation (#4592)

2025-10-30 10:28:36 +08:00

decoder_write_cache_with_rope_impl.cuh

[Feature][OP] Append Attn Support CUDA-PDL (#5072)

2025-11-17 20:47:33 +08:00

decoder_write_cache_with_rope_kernel.cu

[Feature][OP] Append Attn Support CUDA-PDL (#5072)

2025-11-17 20:47:33 +08:00

decoder_write_cache_with_rope_kernel.h

…

encoder_write_cache_with_rope_impl.cuh

[Feature][OP] Append Attn Support CUDA-PDL (#5072)

2025-11-17 20:47:33 +08:00

encoder_write_cache_with_rope_kernel.h

…

get_block_shape_and_split_kv_block.cu

[Others] clean code (#5133)

2025-11-20 18:44:08 +08:00

gqa_rope_write_cache.cu

[Feature] support flash_mask_attention backend (#5134)

2025-11-28 10:12:16 +08:00

mem_util.cuh

[Metax] adapt DeepSeek (#4498)

2025-10-24 10:14:53 +08:00

mla_cache_kernel.cu

[PD Disaggregation] Support PD deployment of DeepSeekv3. (#5251)

2025-12-02 14:11:50 +08:00

mla_cache_kernel.cuh

…

mma_tensor_op.cuh

…

multiquery_attention_c4_impl.cuh

supports mtp split_kv_attn (#5343)

2025-12-03 12:40:16 +08:00

multiquery_attention_c4_kernel.h

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00

multiquery_attention_c8_impl.cuh

supports mtp split_kv_attn (#5343)

2025-12-03 12:40:16 +08:00

multiquery_attention_c8_kernel.h

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00

multiquery_attention_c16_impl.cuh

supports mtp split_kv_attn (#5343)

2025-12-03 12:40:16 +08:00

multiquery_attention_c16_kernel.h

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00

multiquery_decoder_attention_impl.cuh

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

multiquery_decoder_attention_kernel.h

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

pre_cache_len_concat.cu

…

speculate_write_cache_with_rope_impl.cuh

[Speculative Decoding][MTP] Support static CacheKV C8 quantization and optimize memory usage (#5155)

2025-11-21 15:10:13 +08:00

speculate_write_cache_with_rope_kernel.cu

[Speculative Decoding][MTP] Support static CacheKV C8 quantization and optimize memory usage (#5155)

2025-11-21 15:10:13 +08:00

speculate_write_cache_with_rope_kernel.h

…

template_config.json

revert group size 3 (#5079)

2025-11-17 18:54:13 +08:00

utils.cuh

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00