Yuan Xiaolan 7d87aaace8 optimize w4a8 decoding (#3050)

2025-07-28 22:20:13 +08:00

..

cutlass_extensions

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

base64_encode.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

compile_w4a8_moe.sh

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cuda_utils.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

cutlass_heuristic_w4a4.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

w4a4_gemm_configs.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

w4a8_gemm_grouped.h

optimize w4a8 decoding (#3050)

2025-07-28 22:20:13 +08:00

w4a8_moe_cutlass_kernel_template.cu

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

w4a8_moe_cutlass_kernel.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

w4a8_moe_gemm_config_search.sh

optimize w4a8 decoding (#3050)

2025-07-28 22:20:13 +08:00

w4a8_moe_gemm_kernel_template.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

w4a8_moe_gemm_kernel.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

w4a8_moe_gemm_test.cu

optimize w4a8 decoding (#3050)

2025-07-28 22:20:13 +08:00

w4a8_moe_gemm_with_epilogue_visitor.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00

weight_process_utils.h

[LLM] First commit the llm deployment code

2025-06-09 19:20:15 +08:00