GoldPancake cbcb5c6e84 temporary change mtp logprob msg size (#5026) ...

Co-authored-by: YuBaoku <49938469+EmmonsCurse@users.noreply.github.com>
Co-authored-by: gaoziyuan <88373061+gzy19990617@users.noreply.github.com>

2025-11-15 13:39:40 +08:00

..

draft_model

[Feature][MTP]Support MTP for rl-model (#4009)

2025-09-10 13:34:37 +08:00

ngram_match.cc

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

speculate_calcu_accept_ratio.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_clear_accept_nums.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_get_output_padding_offset.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_get_output_with_topk.cc

temporary change mtp logprob msg size (#5026)

2025-11-15 13:39:40 +08:00

speculate_get_output.cc

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

speculate_get_padding_offset.cu

[Executor]CUDAGraph support Speculate Decode (#4258)

2025-10-13 15:21:41 +08:00

speculate_get_seq_lens_output.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_limit_thinking_content_length_v2.cu

support speculate_limit_thinking_content_length_v2 (#4428)

2025-10-16 13:23:16 +08:00

speculate_logprob_utils.cu

[Feature] support mtp logprob (#4457)

2025-10-20 10:18:00 +08:00

speculate_msg.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_save_output_with_topk.cc

temporary change mtp logprob msg size (#5026)

2025-11-15 13:39:40 +08:00

speculate_save_output.cc

[MTP]support mtp chunk_prefill_v1 (#4365)

2025-10-15 15:33:59 +08:00

speculate_schedule_cache.cu

[MTP]support mtp chunk_prefill_v1 (#4365)

2025-10-15 15:33:59 +08:00

speculate_set_value_by_flags.cu

support speculate_limit_thinking_content_length_v2 (#4428)

2025-10-16 13:23:16 +08:00

speculate_step_reschedule.cu

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

speculate_step_system_cache.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_step.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_stop_generation_multi_stop_seqs.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_token_penalty_multi_scores.cu

[Feature] support bad_words (#3055)

2025-07-30 09:31:29 +08:00

speculate_update_input_ids_cpu.cc

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_update.cu

[MTP]Merge support attn (#4591)

2025-10-27 21:13:08 +08:00

speculate_verify.cu

[Feature] support mtp distribution equivalence verification (#4566)

2025-10-27 11:01:28 +08:00

top_p_candidates.cu

[MTP]support more branchs in topp kernel (#4353)

2025-10-11 11:27:35 +08:00

update_attn_mask_offsets.cu

[MTP]Merge support attn (#4591)

2025-10-27 21:13:08 +08:00