ming1753 cba185f1fe [Feature] Optim PaddleOCR-VL (#4873) ...

* [Feature] Optim PaddleOCR-VL

* fix bug

2025-11-07 14:56:44 +08:00

..

append_attn

format code (#4720)

2025-11-01 19:13:50 +08:00

common

…

custom_all_reduce

…

cutlass_extensions

…

cutlass_kernels

…

flash_mask_attn

enhance set_stop_value_multi_ends and standardize the registration of some operators (#4525)

2025-10-21 22:06:06 +08:00

fp8_gemm_with_cutlass

…

glog

…

int8_gemm_with_cutlass

…

machete

WINT4/WINT8 dense gemm default use Machete (#4451)

2025-10-23 17:57:59 +08:00

mla_attn

…

moba_attn

enhance set_stop_value_multi_ends and standardize the registration of some operators (#4525)

2025-10-21 22:06:06 +08:00

moe

Revert "【New Feature】W4afp8 supports per group quantization (#4272)" (#4854)

2025-11-06 17:48:28 +08:00

quantization

…

sample_kernels

…

speculate_decoding

[Speculative Decoding][MTP]Support attn mask offset (#4641)

2025-11-03 10:08:01 +08:00

w4afp8_gemm

Revert "【New Feature】W4afp8 supports per group quantization (#4272)" (#4854)

2025-11-06 17:48:28 +08:00

wfp8afp8_sparse_gemm

…

append_attention.cu

Support GPT-OSS-BF16 (#4240)

2025-10-20 14:44:58 +08:00

beam_search_softmax.cu

…

cpp_extensions.cc

[Feature] Optim PaddleOCR-VL (#4873)

2025-11-07 14:56:44 +08:00

cuda_multiprocess.h

…

dequant_int8.cu

…

enforce_generation.cu

…

env.h

…

fused_get_rotary_embedding.cu

…

fused_hadamard_quant_fp8.cu

…

fused_neox_rope_embedding.cu

[Feature] Optim PaddleOCR-VL (#4873)

2025-11-07 14:56:44 +08:00

fused_rotary_position_encoding.cu

…

gather_idx.cu

…

gelu_tanh.cu

[Feature] Optim PaddleOCR-VL (#4873)

2025-11-07 14:56:44 +08:00

get_data_ptr_ipc.cu

…

get_img_boundaries.cc

enhance set_stop_value_multi_ends and standardize the registration of some operators (#4525)

2025-10-21 22:06:06 +08:00

get_mm_split_fuse.cc

enhance set_stop_value_multi_ends and standardize the registration of some operators (#4525)

2025-10-21 22:06:06 +08:00

get_output_ep.cc

…

get_output_msg_with_topk.cc

…

get_output.cc

…

get_padding_offset_system.cu

…

get_padding_offset.cu

[get_padding_offset.] clean get_padding_offset.cu (#4777)

2025-11-05 10:47:40 +08:00

get_position_ids_and_mask_encoder_batch.cu

…

helper.cu

[Executor] Default use CUDAGraph (#3594)

2025-10-21 14:25:45 +08:00

helper.h

[Metax] adapt DeepSeek (#4498)

2025-10-24 10:14:53 +08:00

init_signal_layerwise.cc

…

ipc_sent_key_value_cache_by_remote_ptr.cu

…

limit_thinking_content_length_v1.cu

[BugFix] fix thinking bug (#4710)

2025-10-31 22:00:31 +08:00

limit_thinking_content_length_v2.cu

[BugFix] fix thinking bug (#4710)

2025-10-31 22:00:31 +08:00

merge_prefill_decode_output.cu

…

msg_utils.h

…

multi_head_latent_attention.cu

【Hackathon 9th No.86】autogen MoeFastHardamardImplWrapper template_instantiation (#4592)

2025-10-30 10:28:36 +08:00

ngram_mask.cu

…

noaux_tc.cu

…

noauxtc_kernel.h

fix noaux (#4731)

2025-10-31 21:25:11 +08:00

open_shm_and_get_meta_signal.cc

…

per_token_quant_fp8.cu

[OP] Add InferShape&InferDtype for per_token_quant_padding (#4667)

2025-10-30 10:28:26 +08:00

read_data_ipc.cu

…

read_ids.py

…

read_temp_ids.py

…

rebuild_padding.cu

[Feature] support mtp logprob (#4464)

2025-10-20 15:18:12 +08:00

recover_decode_task.cu

…

remote_cache_kv_ipc.cc

…

remote_cache_kv_ipc.h

…

save_output_msg_with_topk.cc

…

save_with_output_msg.cc

…

save_with_output_msg.h

…

save_with_output.cc

…

scaled_gemm_f8_i4_f16_gemm.cu

…

scaled_gemm_f8_i4_f16_weight_quantize.cu

…

seqs2seqs.cu

…

set_data_ipc.cu

…

set_flags.cu

…

set_mask_value.cu

…

set_value_by_flags_and_idx.cu

Optimizing the performance of think length limit using custom operators (#4279)

2025-10-20 21:09:13 +08:00

share_external_data.cu

…

step_reschedule.cu

…

step_system_cache.cu

…

step.cu

…

stop_generation_multi_ends.cu

enhance set_stop_value_multi_ends and standardize the registration of some operators (#4525)

2025-10-21 22:06:06 +08:00

stop_generation.cu

…

swap_cache_batch.cu

…

swap_cache.cu

…

system2group.cu

…

text_image_gather_scatter.cu

[Graph Optimization] Fix IR graph dependency error exposed after enabling SOT by updating the return value of TextImageGatherScatter (#4610)

2025-10-28 18:31:23 +08:00

text_image_index_out.cu

…

token_penalty_multi_scores.cu

…

token_penalty_only_once.cu

…

token_transfer.hpp

…

transfer_output.cc

…

tune_cublaslt_gemm.cu

…

unset_data_ipc.cu

…

update_attn_mask_offsets.cu

[Speculative Decoding][MTP]Support attn mask offset (#4641)

2025-11-03 10:08:01 +08:00

update_inputs_beam.cu

[XPU] bind some OPs for VL model with pybind (#4522)

2025-10-27 10:50:08 +08:00

update_inputs_v1.cu

[XPU] bind some OPs for VL model with pybind (#4522)

2025-10-27 10:50:08 +08:00

update_inputs.cu

[XPU] bind some OPs for VL model with pybind (#4522)

2025-10-27 10:50:08 +08:00

update_split_fuse_input.cu

…