Zhenghai Zhang 6adfbe07ad 【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383) ...

* split MultiQueryDecoderAttention template_instantiation

* update comment

* CI

2025-10-16 17:08:19 +08:00

..

template_instantiation

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

append_attention_c4_impl.cuh

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

append_attention_c8_impl.cuh

【Hackathon 9th No.86】autogen MultiQueryAppendC8Attention template_instantiation -part (#4330)

2025-10-10 15:07:48 +08:00

append_attention_c16_impl.cuh

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

append_attention_func.cuh

[Executor]CUDAGraph support Speculate Decode (#3769)

2025-10-09 21:18:29 +08:00

append_attention_kernel.h

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

autogen_template_instantiation.py

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

decode_attention_func.cuh

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

decoder_write_cache_with_rope_impl.cuh

fix dynamic Cfp8 computing error (#4119)

2025-09-16 20:21:49 +08:00

decoder_write_cache_with_rope_kernel.cu

[Feature] Support zai-org/GLM-4.5-Air BF16 model (#3928)

2025-09-10 19:36:10 +08:00

decoder_write_cache_with_rope_kernel.h

clean code in sttantion (#3917)

2025-09-05 20:49:01 +08:00

encoder_write_cache_with_rope_impl.cuh

FIX] Fix CUDA error(700): 'cudaErrorIllegalAddress' in CascadeAppendWriteCacheKVQKV cache_kernel(). Continue when batch_id_per_token[token_idx] is default value -1. (#4218)

2025-09-24 14:08:49 +08:00

encoder_write_cache_with_rope_kernel.h

[Feature] Support zai-org/GLM-4.5-Air BF16 model (#3928)

2025-09-10 19:36:10 +08:00

get_block_shape_and_split_kv_block.cu

[Optimization] Optimize split_q_block kernel (#4367)

2025-10-15 11:28:00 +08:00

gqa_rope_write_cache.cu

fix typos (#3951)

2025-09-08 15:22:41 +08:00

mem_util.cuh

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

mla_cache_kernel.cu

[Feature] DeepseekV3 use pd_build_static_op (#2948)

2025-07-22 15:03:41 +08:00

mla_cache_kernel.cuh

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

mma_tensor_op.cuh

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

multi_head_latent_attention_kernel.h

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

multiquery_attention_c4_impl.cuh

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

multiquery_attention_c4_kernel.h

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

multiquery_attention_c8_impl.cuh

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

multiquery_attention_c8_kernel.h

【Hackathon 9th No.86】autogen MultiQueryAppendC8Attention template_instantiation -part (#4330)

2025-10-10 15:07:48 +08:00

multiquery_attention_c16_impl.cuh

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

multiquery_attention_c16_kernel.h

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

multiquery_decoder_attention_impl.cuh

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

multiquery_decoder_attention_kernel.h

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

pre_cache_len_concat.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_write_cache_with_rope_impl.cuh

[MTP][Cfp8]supports spec dynamic cfp8 (#4290)

2025-10-10 16:08:10 +08:00

speculate_write_cache_with_rope_kernel.cu

[MTP][Cfp8]supports spec dynamic cfp8 (#4290)

2025-10-10 16:08:10 +08:00

speculate_write_cache_with_rope_kernel.h

support mtp rope_3d (#3791)

2025-09-04 17:18:05 +08:00

template_config.json

【Hackathon 9th No.86】autogen MultiQueryDecoderAttention template_instantiation -part (#4383)

2025-10-16 17:08:19 +08:00

utils.cuh

supports dynamic Cfp8 (#3767)

2025-09-07 20:41:29 -07:00