apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-04 08:16:42 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
Files
7cdd8d290d357066ee9d337b1e8d27962e581304
FastDeploy/custom_ops/gpu_ops/speculate_decoding
History
freeliuzc 7cdd8d290d
Some checks failed
Deploy GitHub Pages / deploy (push) Has been cancelled
Details
[MTP] optimize mtp infer speed (#2840)
2025-07-14 19:50:22 +08:00
..
draft_model
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
ngram_match.cc
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
speculate_calcu_accept_ratio.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_clear_accept_nums.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_get_output_padding_offset.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_get_output.cc
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
speculate_get_padding_offset.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_get_seq_lens_output.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_hydra_set_score_threshold.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_hydra_update_seqlens_this_time.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_msg.h
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_rebuild_append_padding.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_save_output.cc
Sync v2.0 version of code to github repo
2025-06-29 23:29:37 +00:00
speculate_set_value_by_flags.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_step_reschedule.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_step_system_cache.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_step.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_stop_generation_multi_stop_seqs.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_token_penalty_multi_scores.cu
[MTP] optimize mtp infer speed (#2840)
2025-07-14 19:50:22 +08:00
speculate_update_input_ids_cpu.cc
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_update_seq_lens_this_time.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_update_v2.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_update_v3.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00
speculate_verify.cu
[MTP] optimize mtp infer speed (#2840)
2025-07-14 19:50:22 +08:00
top_p_candidates.cu
[LLM] First commit the llm deployment code
2025-06-09 19:20:15 +08:00