apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-05 16:48:03 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity
Files
5be18dea000b9976b12b152f3bb2055e34e6efec
FastDeploy/custom_ops/gpu_ops
History
jiangjiajun 149c79699d [LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
..
append_attn
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
common
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
cutlass_extensions
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
cutlass_kernels
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
fp8_deep_gemm
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
fp8_gemm_with_cutlass
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
glog
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
int8_gemm_with_cutlass
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
moe
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
speculate_decoding
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
air_topp_sampling.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
append_attention.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
beam_search_softmax.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
cpp_extensions.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
cuda_multiprocess.h
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
dequant_int8.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
enforce_generation.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
extract_text_token_output.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
fused_get_rope.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
gather_idx.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
get_data_ptr_ipc.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
get_mm_split_fuse.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
get_output_ep.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
get_output_msg_with_topk.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
get_output.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
get_padding_offset_system.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
get_padding_offset.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
helper.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
helper.h
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
init_signal_layerwise.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
ipc_sent_key_value_cache_by_remote_ptr.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
msg_utils.h
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
ngram_mask.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
open_shm_and_get_meta_signal.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
per_token_quant_fp8.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
read_data_ipc.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
read_ids.py
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
read_temp_ids.py
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
rebuild_padding.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
remote_cache_kv_ipc.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
remote_cache_kv_ipc.h
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
reset_need_stop_value.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
save_output_msg_with_topk.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
save_with_output_msg.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
save_with_output_msg.h
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
save_with_output.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
scaled_gemm_f8_i4_f16_gemm.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
scaled_gemm_f8_i4_f16_weight_quantize.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
seqs2seqs.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
set_data_ipc.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
set_flags.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
set_mask_value.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
set_value_by_flags.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
share_external_data.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
step_reschedule.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
step_system_cache.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
step.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
stop_generation_multi_ends.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
stop_generation_multi_stop_seqs.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
stop_generation.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
swap_cache_batch.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
swap_cache.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
system2group.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
token_penalty_multi_scores.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
token_penalty_only_once.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
token_transfer.hpp
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
transfer_output.cc
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
tune_cublaslt_gemm.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
update_inputs_beam.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
update_inputs.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00
update_split_fuse_input.cu
[LLM] First commit the llm deployment code
2025-06-16 00:04:48 +08:00