Jundong Liu ea4a3b479c [Excutor] Increase buffer size to prevent address corruption; add forward metadata debug tool (#3404) ...

* 修复buffer申请不够大，增加打印forwardmetadata的工具

* fix mistake

* Make CPU tensor in CPUPlace

* Add test about forward_meta_str and Add unitest_requirement

---------

Co-authored-by: RAM <gstian5555@outlook.com>

2025-08-18 16:14:09 +08:00

..

template_instantiation

support qk norm (#3145)

2025-08-05 16:46:14 +08:00

append_attention_c4_impl.cuh

make append_attn supports mask_offset (#3138)

2025-08-14 03:40:55 -07:00

append_attention_c8_impl.cuh

make append_attn supports mask_offset (#3138)

2025-08-14 03:40:55 -07:00

append_attention_c16_impl.cuh

make append_attn supports mask_offset (#3138)

2025-08-14 03:40:55 -07:00

append_attention_func.cuh

make append_attn supports mask_offset (#3138)

2025-08-14 03:40:55 -07:00

append_attention_kernel.h

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

decode_attention_func.cuh

[Sync] Update to latest code (#2679)

2025-07-03 15:43:53 +08:00

decode_attention_kernel.cu

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

decoder_write_cache_with_rope_impl.cuh

[Bugfix] Fix model accuracy in some ops (#3231)

2025-08-08 17:30:37 +08:00

decoder_write_cache_with_rope_kernel.cu

[Bugfix] Fix model accuracy in some ops (#3231)

2025-08-08 17:30:37 +08:00

decoder_write_cache_with_rope_kernel.h

support qk norm (#3145)

2025-08-05 16:46:14 +08:00

encoder_write_cache_with_rope_impl.cuh

[Bugfix] Fix model accuracy in some ops (#3231)

2025-08-08 17:30:37 +08:00

encoder_write_cache_with_rope_kernel.h

support qk norm (#3145)

2025-08-05 16:46:14 +08:00

get_block_shape_and_split_kv_block.cu

[Excutor] Increase buffer size to prevent address corruption; add forward metadata debug tool (#3404)

2025-08-18 16:14:09 +08:00

gqa_rope_write_cache.cu

fix c4 prompt_cache

2025-07-28 14:31:37 +08:00

mem_util.cuh

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

mla_cache_kernel.cu

[Feature] DeepseekV3 use pd_build_static_op (#2948)

2025-07-22 15:03:41 +08:00

mla_cache_kernel.cuh

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

mma_tensor_op.cuh

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

multi_head_latent_attention_kernel.h

[Inference, rename] remove padding_offsets from atten use batch_id_per_token (#2880)

2025-07-17 18:41:31 +08:00

pre_cache_len_concat.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_write_cache_with_rope_impl.cuh

support c4 attn && fix cache

2025-07-24 12:00:52 +08:00

speculate_write_cache_with_rope_kernel.cu

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

speculate_write_cache_with_rope_kernel.h

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

utils.cuh

make append_attn supports mask_offset (#3138)

2025-08-14 03:40:55 -07:00