Sunny-bot1 8c43bc8176 [FIX 2.0.3]fix rejection sampling when topp=0 using _SAMPLING_EPS (#2966) ...

* fix rejection sampling when topp=0

* fix

* fix

2025-07-22 05:53:04 -07:00

..

append_attn

[Attention] remove cum_offsets from atten, and use cu_seqlens_q (#2870)

2025-07-16 20:10:57 +08:00

common

…

custom_all_reduce

[Feature] support custom all-reduce (#2758)

2025-07-09 16:00:27 +08:00

cutlass_extensions

Feat/blackwell sm100 support (#2670)

2025-07-09 15:29:42 +08:00

cutlass_kernels

refactor rl get_name_mappings_to_training (#2847)

2025-07-15 07:31:42 -07:00

fp8_gemm_with_cutlass

…

glog

…

int8_gemm_with_cutlass

…

mla_attn

[Attention] remove cum_offsets from atten, and use cu_seqlens_q (#2870)

2025-07-16 20:10:57 +08:00

moe

refactor rl get_name_mappings_to_training (#2847)

2025-07-15 07:31:42 -07:00

quantization

…

sample_kernels

[FIX 2.0.3]fix rejection sampling when topp=0 using _SAMPLING_EPS (#2966)

2025-07-22 05:53:04 -07:00

speculate_decoding

[MTP] optimize mtp infer speed (#2840)

2025-07-14 19:50:22 +08:00

append_attention.cu

[Attention] remove cum_offsets from atten, and use cu_seqlens_q (#2870)

2025-07-16 20:10:57 +08:00

beam_search_softmax.cu

…

cpp_extensions.cc

[Attention] remove cum_offsets from atten, and use cu_seqlens_q (#2870)

2025-07-16 20:10:57 +08:00

cuda_multiprocess.h

…

dequant_int8.cu

…

enforce_generation.cu

…

env.h

…

extract_text_token_output.cu

…

fused_get_rope.cu

…

fused_hadamard_quant_fp8.cu

…

fused_rotary_position_encoding.cu

…

gather_idx.cu

…

get_data_ptr_ipc.cu

…

get_mm_split_fuse.cc

…

get_output_ep.cc

…

get_output_msg_with_topk.cc

[Feature] Online Chat API Support Return logprobs (#2777)

2025-07-10 16:33:40 +08:00

get_output.cc

…

get_padding_offset_system.cu

…

get_padding_offset.cu

…

get_position_ids_and_mask_encoder_batch.cu

…

helper.cu

…

helper.h

dcu adapter ernie45t (#2756)

2025-07-09 18:56:27 +08:00

init_signal_layerwise.cc

…

ipc_sent_key_value_cache_by_remote_ptr.cu

…

msg_utils.h

…

multi_head_latent_attention.cu

[Attention] remove cum_offsets from atten, and use cu_seqlens_q (#2870)

2025-07-16 20:10:57 +08:00

ngram_mask.cu

…

noaux_tc.cu

…

noauxtc_kernel.h

…

open_shm_and_get_meta_signal.cc

…

per_token_quant_fp8.cu

…

read_data_ipc.cu

…

read_ids.py

…

read_temp_ids.py

…

rebuild_padding.cu

…

remote_cache_kv_ipc.cc

…

remote_cache_kv_ipc.h

…

save_output_msg_with_topk.cc

[Feature] Online Chat API Support Return logprobs (#2777)

2025-07-10 16:33:40 +08:00

save_with_output_msg.cc

…

save_with_output_msg.h

…

save_with_output.cc

…

scaled_gemm_f8_i4_f16_gemm.cu

…

scaled_gemm_f8_i4_f16_weight_quantize.cu

…

seqs2seqs.cu

…

set_data_ipc.cu

dcu adapter ernie45t (#2756)

2025-07-09 18:56:27 +08:00

set_flags.cu

…

set_mask_value.cu

…

set_value_by_flags.cu

…

share_external_data.cu

dcu adapter ernie45t (#2756)

2025-07-09 18:56:27 +08:00

step_reschedule.cu

…

step_system_cache.cu

…

step.cu

…

stop_generation_multi_ends.cu

…

stop_generation_multi_stop_seqs.cu

…

stop_generation.cu

…

swap_cache_batch.cu

…

swap_cache.cu

…

system2group.cu

…

text_image_gather_scatter.cu

…

text_image_index_out.cu

…

token_penalty_multi_scores.cu

[Feature] support prompt repetition_penalty (#2954)

2025-07-22 19:42:33 +08:00

token_penalty_only_once.cu

…

token_transfer.hpp

…

transfer_output.cc

…

tune_cublaslt_gemm.cu

…

update_inputs_beam.cu

…

update_inputs.cu

…

update_split_fuse_input.cu

…