apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-12-24 13:28:13 +08:00
Code Issues Actions 2 Packages Projects Releases Wiki Activity

fix scaled_gemm_f8_i4_f16_weight_quantize input (#3685)

Browse Source
This commit is contained in:
co63oc
2025-08-29 11:04:04 +08:00
committed by GitHub
parent 2fb2c0f46a
commit b6edd15d55
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
custom_ops/gpu_ops/scaled_gemm_f8_i4_f16_weight_quantize.cu
View File

@@ -217,7 +217,7 @@ std::vector<paddle::DataType> Fp8Int4WeightQuantizeInferDtype(
PD_BUILD_STATIC_OP(scaled_gemm_f8_i4_f16_weight_quantize)
.Inputs({"intput"})
.Inputs({"input"})
.Attrs({"groupsize: int",
"scale_dtype: std::string"})
.Outputs({"output", "scale"})