apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
Files
05c1167c7443cb183f417164cffbbb7703e6466e
FastDeploy/custom_ops/gpu_ops/speculate_decoding
History
freeliuzc c9be8762b6
Some checks failed
CE Compile Job / ce_job_pre_check (push) Has been cancelled
Details
CE Compile Job / print_ce_job_pre_check_outputs (push) Has been cancelled
Details
CE Compile Job / FD-Clone-Linux (push) Has been cancelled
Details
CE Compile Job / Show Code Archive Output (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8090 (push) Has been cancelled
Details
CE Compile Job / BUILD_SM8689 (push) Has been cancelled
Details
CE Compile Job / CE_UPLOAD (push) Has been cancelled
Details
[MTP]Merge support attn (#4591) 
* support mask_offset in speculate decoding

* fix dummpy run output

* add unit test

* fix unit test import
2025-10-27 21:13:08 +08:00
..
draft_model
[Feature][MTP]Support MTP for rl-model (#4009)
2025-09-10 13:34:37 +08:00
ngram_match.cc
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
speculate_calcu_accept_ratio.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_clear_accept_nums.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_get_output_padding_offset.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_get_output_with_topk.cc
[Feature] support mtp logprob (#4457)
2025-10-20 10:18:00 +08:00
speculate_get_output.cc
[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)
2025-08-26 14:29:22 +08:00
speculate_get_padding_offset.cu
[Executor]CUDAGraph support Speculate Decode (#4258)
2025-10-13 15:21:41 +08:00
speculate_get_seq_lens_output.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_limit_thinking_content_length_v2.cu
support speculate_limit_thinking_content_length_v2 (#4428)
2025-10-16 13:23:16 +08:00
speculate_logprob_utils.cu
[Feature] support mtp logprob (#4457)
2025-10-20 10:18:00 +08:00
speculate_msg.h
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_save_output_with_topk.cc
[Feature] support mtp logprob (#4457)
2025-10-20 10:18:00 +08:00
speculate_save_output.cc
[MTP]support mtp chunk_prefill_v1 (#4365)
2025-10-15 15:33:59 +08:00
speculate_schedule_cache.cu
[MTP]support mtp chunk_prefill_v1 (#4365)
2025-10-15 15:33:59 +08:00
speculate_set_value_by_flags.cu
support speculate_limit_thinking_content_length_v2 (#4428)
2025-10-16 13:23:16 +08:00
speculate_step_reschedule.cu
polish code with new pre-commit rule (#2923)
2025-07-19 23:19:27 +08:00
speculate_step_system_cache.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_step.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_stop_generation_multi_stop_seqs.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_token_penalty_multi_scores.cu
[Feature] support bad_words (#3055)
2025-07-30 09:31:29 +08:00
speculate_update_input_ids_cpu.cc
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_update.cu
[MTP]Merge support attn (#4591)
2025-10-27 21:13:08 +08:00
speculate_verify.cu
[Feature] support mtp distribution equivalence verification (#4566)
2025-10-27 11:01:28 +08:00
top_p_candidates.cu
[MTP]support more branchs in topp kernel (#4353)
2025-10-11 11:27:35 +08:00
update_attn_mask_offsets.cu
[MTP]Merge support attn (#4591)
2025-10-27 21:13:08 +08:00