freeliuzc 365601ea5a [MTP]support more branchs in topp kernel (#4352)

2025-10-11 11:33:52 +08:00

..

draft_model

rename eagle_get_base_model_hidden_states.cu (#3753)

2025-09-07 10:24:58 +08:00

ngram_match.cc

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

speculate_calcu_accept_ratio.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_clear_accept_nums.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_get_output_padding_offset.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_get_output.cc

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

speculate_get_padding_offset.cu

[Executor]CUDAGraph support Speculate Decode (#3769)

2025-10-09 21:18:29 +08:00

speculate_get_seq_lens_output.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_get_token_penalty_multi_scores.cu

rename speculate_token_penalty_multi_scores.cu (#3735)

2025-09-02 18:12:11 +08:00

speculate_msg.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_save_output.cc

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

speculate_schedule_cache.cu

support mtp in v1_scheduler mode (#3695)

2025-09-04 17:39:59 +08:00

speculate_set_stop_value_multi_seqs.cu

rename speculate_stop_generation_multi_stop_seqs (#3743)

2025-09-02 18:04:29 +08:00

speculate_set_value_by_flags_and_idx.cu

rename fused_get_rope.cu (#3752)

2025-09-03 10:54:34 +08:00

speculate_step_reschedule.cu

fix typos (#3684)

2025-09-01 17:50:17 +08:00

speculate_step_system_cache.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_step.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_update_input_ids_cpu.cc

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

speculate_update.cu

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

speculate_verify.cu

[Executor]CUDAGraph support Speculate Decode (#3769)

2025-10-09 21:18:29 +08:00

top_p_candidates.cu

[MTP]support more branchs in topp kernel (#4352)

2025-10-11 11:33:52 +08:00