AIbin 22fe695f1c 【Inference Optimize】Support automatic generation of marlin kernel (#3149) ...

* Support automatic generation of marlin kernel

2025-08-01 22:43:18 +08:00

..

moe_wna16_marlin_utils

【Inference Optimize】Support automatic generation of marlin kernel (#3149)

2025-08-01 22:43:18 +08:00

deepgemm_preprocess.cu

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

ep_moe_prefill_func.cu

moe preprocess op support 160 experts and fused_moe triton kernel name add K (#3121)

2025-08-01 10:46:20 +08:00

fast_hardamard_kernel.cu

optimize w4a8 decoding (#3050)

2025-07-28 22:20:13 +08:00

fast_hardamard_kernel.h

optimize w4a8 decoding (#3050)

2025-07-28 22:20:13 +08:00

fused_moe_helper.h

refactor rl get_name_mappings_to_training (#2847)

2025-07-15 07:31:42 -07:00

fused_moe_imp_op.h

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

fused_moe_op.h

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

fused_moe.cu

refactor rl get_name_mappings_to_training (#2847)

2025-07-15 07:31:42 -07:00

gptq_marlin_repack.cu

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

group_swiglu_with_masked.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

group_swiglu_with_masked.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

moe_deepgemm_depermute.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

moe_deepgemm_permute.cu

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

moe_dispatch.cu

polish code with new pre-commit rule (#2923)

2025-07-19 23:19:27 +08:00

moe_ffn_wint2.cu

Optimize the performance of moe_expert_ffn_wint2 (#2990)

2025-07-28 10:32:43 +08:00

moe_ffn.cu

optimize w4a8 decoding (#3050)

2025-07-28 22:20:13 +08:00

moe_reduce.cu

refactor rl get_name_mappings_to_training (#2847)

2025-07-15 07:31:42 -07:00

moe_redundant_topk_select.cu

[Feature] Support_eplb (#2997)

2025-07-24 20:22:45 +08:00

moe_topk_select.cu

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

moe_wna16_marlin_gemm.cu

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

moe_wna16_marlin_gemm.h

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00

tritonmoe_preprocess.cu

moe preprocess op support 160 experts and fused_moe triton kernel name add K (#3121)

2025-08-01 10:46:20 +08:00

wintx_unzip.cu

Sync v2.0 version of code to github repo

2025-06-29 23:29:37 +00:00