AIbin a7392a0ff9 【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886) ...

* support MLA chunk_size auto search & cuda_graph

2025-09-11 10:46:09 +08:00

..

test_air_top_p_sampling.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_cutlass_fp8_fp8_fp8_dual_gemm_fused.py

【Hackathon 9th No.28】add test_cutlass_fp8_fp8_fp8_dual_gemm_fused (#3935)

2025-09-10 14:57:49 +08:00

test_cutlass_scaled_mm.py

fix typos (#3633)

2025-08-28 14:42:24 +08:00

test_deqant_int8_cpp_extension.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_dequant.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_draft_model_postprocess.py

【Hackathon 9th No.63】add test_draft_model_postprocess.py (#3757)

2025-09-04 15:00:48 +08:00

test_draft_model_preprocess.py

【Hackathon 9th No.69】add test_draft_model_preprocess (#3832)

2025-09-08 17:08:50 +08:00

test_draft_model_set_value_by_flags.py

[MTP] add test_draft_model_set_value_by_flags.py (#3741)

2025-09-02 19:33:33 +08:00

test_eagle_get_hidden_states.py

[UnitTest][MTP]add test_eagle_get_hidden_states (#3876)

2025-09-08 17:10:01 +08:00

test_eagle_get_self_hidden_states.py

[UnitTest][MTP]add test_eagle_get_hidden_states (#3876)

2025-09-08 17:10:01 +08:00

test_extract_text_token_output.py

【Hackathon 9th No.36】add test_extract_text_token_output(#3862)

2025-09-08 17:31:58 +08:00

test_flash_mask_attn.py

[CI] Standard unittest (#3606)

2025-08-26 19:03:11 +08:00

test_fp8_fp8_half_cuda_core_gemm.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_fused_moe.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_get_padding_offset.py

【Hackathon 9th No.27】add test_get_padding_offset (#3708)

2025-09-04 11:42:35 +08:00

test_get_position_ids_and_mask_encoder_batch.py

【Hackathon 9th No.34】add test_get_position_ids_and_mask_encoder_batch (#3739)

2025-09-04 14:54:30 +08:00

test_get_token_penalty_multi_scores.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_group_swiglu_with_masked.py

【Hackathon 9th No.32】add unit tests for group_swiglu_with_masked (#3748)

2025-09-05 11:53:47 +08:00

test_hybrid_mtp_ngram.py

[Feature][MTP]support new speculative decoding method named hybrid mtp with ngram (#3610)

2025-08-26 14:29:22 +08:00

test_machete_mm.py

[Optimize]support machete weight only gemm (#3561)

2025-08-28 09:49:58 +08:00

test_moe_redundant_topk_select.py

【Hackathon 9th No.35】add test_moe_redundant_topk_select (#3867)

2025-09-05 11:29:02 +08:00

test_moe_top_k_select.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_ngram_match.py

[UnitTest][MTP] supplementary unit test for ngram_match (#3732)

2025-09-08 17:06:06 +08:00

test_noaux_tc.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_per_token_quant.py

【Hackathon 9th No.54、57】 add unit tests for per_token_quant and per_token_quant_padding (#3746)

2025-09-04 11:46:38 +08:00

test_rejection_top_p_sampling.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_scaled_gemm_f8_i4_f16.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_share_external_data.py

【Hackathon 9th No.22】add unit tests for share_external_data (#3744)

2025-09-08 17:05:48 +08:00

test_speculate_get_output_padding_offset.py

[UnitTest][MTP]add test_speculate_get_output_padding_offset (#3740)

2025-09-03 22:21:21 +08:00

test_speculate_get_padding_offset.py

[UnitTest][MTP]add test_speculate_get_padding_offset (#3730)

2025-09-03 22:21:02 +08:00

test_speculate_get_seq_lens_output.py

[UnitTest][MTP]add test_speculate_get_padding_offset (#3730)

2025-09-03 22:21:02 +08:00

test_speculate_get_token_penalty_multi_scores.py

[UnitTest][MTP] add test_speculate_get_token_penalty_multi_scores.py (#3742)

2025-09-08 17:07:11 +08:00

test_speculate_set_stop_value_multi_seqs.py

[UnitTest][MTP]add test_speculate_set_stop_value_multi_seqs.py (#3941)

2025-09-08 17:11:00 +08:00

test_speculative_schedule_cache.py

support mtp in v1_scheduler mode (#3695)

2025-09-04 17:39:59 +08:00

test_split_fuse.py

[CI] Standard unittest (#3606)

2025-08-26 19:03:11 +08:00

test_stop_generation_multi_ends.py

Add stable ci (#3460)

2025-08-20 08:57:17 +08:00

test_token_penalty.py

[CI] Standard unittest (#3606)

2025-08-26 19:03:11 +08:00

test_tree_mask.py

【Inference Optimize】DeepSeek-V3-model MLA Optimize (#3886)

2025-09-11 10:46:09 +08:00

test_w4afp8_gemm.py

fix typos (#3633)

2025-08-28 14:42:24 +08:00

test_wfp8afp8_sparse_gemm.py

fix typos (#3633)

2025-08-28 14:42:24 +08:00