FastDeploy

test_air_top_p_sampling.py

…

test_cutlass_fp8_fp8_fp8_dual_gemm_fused.py

【Hackathon 9th No.28】add test_cutlass_fp8_fp8_fp8_dual_gemm_fused (#3935 )

2025-09-10 14:57:49 +08:00

test_cutlass_scaled_mm.py

…

test_deqant_int8_cpp_extension.py

…

test_dequant.py

…

test_draft_model_postprocess.py

…

test_draft_model_preprocess.py

【Hackathon 9th No.69】add test_draft_model_preprocess (#3832 )

2025-09-08 17:08:50 +08:00

test_draft_model_set_value_by_flags.py

…

test_draft_model_update.py

【Hackathon 9th No.61、65】add test_draft_model_update (#3940 )

2025-09-15 11:19:50 +08:00

test_dynamic_per_token_scaled_fp8_quant.py

【Hackathon 9th No.52】add test_dynamic_per_token_scaled_fp8_quant (#4015 )

2025-09-16 14:11:29 +08:00

test_eagle_get_hidden_states.py

[UnitTest][MTP]add test_eagle_get_hidden_states (#3876 )

2025-09-08 17:10:01 +08:00

test_eagle_get_self_hidden_states.py

[UnitTest][MTP]add test_eagle_get_hidden_states (#3876 )

2025-09-08 17:10:01 +08:00

test_flash_mask_attn.py

…

test_fp8_fp8_half_cuda_core_gemm.py

…

test_fused_get_rotary_embedding.py

【Hackathon 9th No.25】add test_fused_get_rotary_embedding (#3892 )

2025-09-12 15:38:43 +08:00

test_fused_hadamard_quant_fp8.py

【Hackathon 9th No.21、23】add unit tests for fused_hadamard_quant_fp8, moe_fused_hadamard_quant_fp8 (#4094 )

2025-09-25 12:15:00 +08:00

test_fused_moe.py

…

test_fused_neox_rope_embedding.py

[Feature] Optim PaddleOCR-VL (#4873 )

2025-11-07 14:56:44 +08:00

test_fused_rotary_position_encoding.py

【Hackathon 9th No.46】add test_fused_rotary_position_encoding (#3848 )

2025-09-19 17:50:19 +08:00

test_gelu_tanh.py

[Feature] Optim PaddleOCR-VL (#4873 )

2025-11-07 14:56:44 +08:00

test_get_padding_offset.py

[get_padding_offset.] clean get_padding_offset.cu (#4777 )

2025-11-05 10:47:40 +08:00

test_get_position_ids_and_mask_encoder_batch.py

…

test_get_token_penalty_multi_scores.py

…

test_group_swiglu_with_masked.py

…

test_hybrid_mtp_ngram.py

…

test_limit_thinking_content_length.py

[BugFix] fix thinking bug (#4710 )

2025-10-31 22:00:31 +08:00

test_machete_mm.py

[Optimize] Machete using group scale default (#4121 )

2025-09-18 13:51:11 +08:00

test_masked_per_token_quant.py

【Hackathon 9th No.20】add unit tests for masked_per_token_quant (#4111 )

2025-10-13 14:51:11 +08:00

test_moe_redundant_topk_select.py

…

test_moe_top_k_select.py

…

test_ngram_match.py

[UnitTest][MTP] supplementary unit test for ngram_match (#3732 )

2025-09-08 17:06:06 +08:00

test_noaux_tc.py

Fix noaux_tc cuda Error 700 in CUDAGraph (#4174 )

2025-09-23 18:41:33 +08:00

test_per_token_quant.py

…

test_pre_cache_len_concat.py

【Hackathon 9th No.49】add test_pre_cache_len_concat (#3847 )

2025-09-15 11:20:14 +08:00

test_rebuild_padding.py

[Feature] support mtp logprob (#4464 )

2025-10-20 15:18:12 +08:00

test_rejection_top_p_sampling.py

…

test_scaled_gemm_f8_i4_f16.py

…

test_set_value_by_flags_and_idx.py

Optimizing the performance of think length limit using custom operators (#4279 )

2025-10-20 21:09:13 +08:00

test_share_external_data.py

【Hackathon 9th No.22】add unit tests for share_external_data (#3744 )

2025-09-08 17:05:48 +08:00

test_speculate_get_output_padding_offset.py

…

test_speculate_get_padding_offset.py

…

test_speculate_get_seq_lens_output.py

…

test_speculate_get_target_logits.py

Add ut for speculative sampler (#4650 )

2025-10-30 10:37:49 +08:00

test_speculate_get_token_penalty_multi_scores.py

[UnitTest][MTP] add test_speculate_get_token_penalty_multi_scores.py (#3742 )

2025-09-08 17:07:11 +08:00

test_speculate_insert_first_token.py

Add ut for speculative sampler (#4650 )

2025-10-30 10:37:49 +08:00

test_speculate_limit_thinking_content_length.py

[BugFix] fix thinking bug (#4710 )

2025-10-31 22:00:31 +08:00

test_speculate_set_stop_value_multi_seqs.py

[UnitTest][MTP]add test_speculate_set_stop_value_multi_seqs.py (#3941 )

2025-09-08 17:11:00 +08:00

test_speculate_update.py

[Speculative Decoding][MTP]Support attn mask offset (#4641 )

2025-11-03 10:08:01 +08:00

test_speculate_verify.py

[Feature] support mtp distribution equivalence verification (#4699 )

2025-10-31 11:45:04 +08:00

test_speculative_schedule_cache.py

[MTP]support mtp chunk_prefill_v1 (#4366 )

2025-10-15 13:21:32 +08:00

test_split_fuse.py

…

test_stop_generation_multi_ends.py

…

test_token_penalty.py

…

test_top_k_renorm_probs.py

【Hackathon 9th No.37】add test_top_k_renorm_probs (#3755 )

2025-09-16 11:12:46 +08:00

test_top_p_candidates.py

[MTP][Unit Test]add test_top_p_candidates (#4046 )

2025-09-22 17:06:38 +08:00

test_tree_mask.py

[Speculative Decoding][MTP]Support attn mask offset (#4641 )

2025-11-03 10:08:01 +08:00

test_tritonmoe_preprocess.py

【Hackathon 9th No.30】add test_tritonmoe_preprocess (#3891 )

2025-09-22 15:31:32 +08:00

test_update_attn_mask.py

[Speculative Decoding][MTP]Support attn mask offset (#4641 )

2025-11-03 10:08:01 +08:00

test_update_inputs_v1.py

【Hackathon 9th No.55】add test_update_inputs_v1.py (#3992 )

2025-09-11 11:34:22 +08:00

test_w4afp8_gemm.py

Revert "【New Feature】W4afp8 supports per group quantization (#4272 )" (#4854 )

2025-11-06 17:48:28 +08:00

test_wfp8afp8_sparse_gemm.py

…