From d197f7d7d4a4249088529943cc1e28b97aaddd84 Mon Sep 17 00:00:00 2001 From: heliqi <1101791222@qq.com> Date: Fri, 1 Mar 2024 11:02:28 +0800 Subject: [PATCH 1/3] update serving images (#2387) Co-authored-by: root --- serving/README.md | 4 ++-- serving/README_CN.md | 4 ++-- 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/serving/README.md b/serving/README.md index 329a5ba30..3e26df5f4 100644 --- a/serving/README.md +++ b/serving/README.md @@ -22,7 +22,7 @@ FastDeploy builds an end-to-end serving deployment based on [Triton Inference Se CPU images only support Paddle/ONNX models for serving deployment on CPUs, and supported inference backends include OpenVINO, Paddle Inference, and ONNX Runtime ```shell -docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.4-cpu-only-21.10 +docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.7-cpu-only-21.10 ``` #### GPU Image @@ -30,7 +30,7 @@ docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.4-cpu-only-21.10 GPU images support Paddle/ONNX models for serving deployment on GPU and CPU, and supported inference backends including OpenVINO, TensorRT, Paddle Inference, and ONNX Runtime ``` -docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.4-gpu-cuda11.4-trt8.5-21.10 +docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.7-gpu-cuda11.4-trt8.5-21.10 ``` Users can also compile the image by themselves according to their own needs, referring to the following documents: diff --git a/serving/README_CN.md b/serving/README_CN.md index 2a7f2c39c..9575880d8 100644 --- a/serving/README_CN.md +++ b/serving/README_CN.md @@ -18,13 +18,13 @@ FastDeploy基于[Triton Inference Server](https://github.com/triton-inference-se #### CPU镜像 CPU镜像仅支持Paddle/ONNX模型在CPU上进行服务化部署，支持的推理后端包括OpenVINO、Paddle Inference和ONNX Runtime ``` shell -docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.4-cpu-only-21.10 +docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.7-cpu-only-21.10 ``` #### GPU镜像 GPU镜像支持Paddle/ONNX模型在GPU/CPU上进行服务化部署，支持的推理后端包括OpenVINO、TensorRT、Paddle Inference和ONNX Runtime ``` -docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.4-gpu-cuda11.4-trt8.5-21.10 +docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.7-gpu-cuda11.4-trt8.5-21.10 ``` 用户也可根据自身需求，参考如下文档自行编译镜像 From cc8d1f3c9f31ea4919972f14ee3eaaa9a09966e2 Mon Sep 17 00:00:00 2001 From: ChaoII <849453582@qq.com> Date: Tue, 5 Mar 2024 13:37:20 +0800 Subject: [PATCH 2/3] [BUG FIX] add export declaration of GaussianRandom function (#2379) * Update fd_type.cc [bug fix]add define for destroy TwoDimArrayCstr for c_api * [BUG FIX] add export declaration of GaussianRandom function --- c_api/fastdeploy_capi/core/fd_type.cc | 2 ++ fastdeploy/function/gaussian_random.h | 2 +- 2 files changed, 3 insertions(+), 1 deletion(-) diff --git a/c_api/fastdeploy_capi/core/fd_type.cc b/c_api/fastdeploy_capi/core/fd_type.cc index c3a742778..252fe2256 100644 --- a/c_api/fastdeploy_capi/core/fd_type.cc +++ b/c_api/fastdeploy_capi/core/fd_type.cc @@ -38,6 +38,8 @@ DECLARE_AND_IMPLEMENT_FD_TYPE_ONEDIMARRAY(OneDimArrayFloat) DECLARE_AND_IMPLEMENT_FD_TYPE_ONEDIMARRAY(Cstr) // FD_C_OneDimArrayCstr DECLARE_AND_IMPLEMENT_FD_TYPE_TWODIMARRAY(OneDimArrayCstr, Cstr) +// FD_C_TwoDimArrayCstr +DECLARE_AND_IMPLEMENT_FD_TYPE_THREEDIMARRAY(TwoDimArrayCstr,OneDimArrayCstr) // FD_C_TwoDimArraySize DECLARE_AND_IMPLEMENT_FD_TYPE_TWODIMARRAY(TwoDimArraySize, OneDimArraySize) // FD_C_TwoDimArrayInt8 diff --git a/fastdeploy/function/gaussian_random.h b/fastdeploy/function/gaussian_random.h index 85a4ff8a6..98fdc753d 100644 --- a/fastdeploy/function/gaussian_random.h +++ b/fastdeploy/function/gaussian_random.h @@ -28,7 +28,7 @@ namespace function { @param seed The seed of random generator. @param dtype The data type of the output Tensor. */ -void GaussianRandom(const std::vector& shape, FDTensor* out, +FASTDEPLOY_DECL void GaussianRandom(const std::vector& shape, FDTensor* out, FDDataType dtype = FDDataType::FP32, float mean = 0.0f, float std = 1.0f, int seed = 0); From df7758d4003a5ca52c8a71c40512bf413f958416 Mon Sep 17 00:00:00 2001 From: ChaoII <849453582@qq.com> Date: Fri, 29 Mar 2024 09:29:09 +0800 Subject: [PATCH 3/3] [DOC]fix doc dead link --- serving/README.md | 2 +- serving/README_CN.md | 16 ++++++++-------- 2 files changed, 9 insertions(+), 9 deletions(-) diff --git a/serving/README.md b/serving/README.md index 3e26df5f4..0e7d2e13f 100644 --- a/serving/README.md +++ b/serving/README.md @@ -56,4 +56,4 @@ Users can also compile the image by themselves according to their own needs, ref | NLP | [PaddleNLP/ERNIE-3.0](../examples/text/ernie-3.0/serving/README.md)| | NLP | [PaddleNLP/UIE](../examples/text/uie/serving/README.md)| | Speech | [PaddleSpeech/PP-TTS](../examples/audio/pp-tts/serving/README.md)| -| OCR | [PaddleOCR/PP-OCRv3](../examples/vision/ocr/PP-OCRv3/serving/README.md)| +| OCR | [PaddleOCR/PP-OCRv3](../examples/vision/ocr/PP-OCR/serving/fastdeploy_serving/README.md)| diff --git a/serving/README_CN.md b/serving/README_CN.md index 9575880d8..ab0245b1d 100644 --- a/serving/README_CN.md +++ b/serving/README_CN.md @@ -40,12 +40,12 @@ docker pull registry.baidubce.com/paddlepaddle/fastdeploy:1.0.7-gpu-cuda11.4-trt ### 服务化部署示例 -| 任务场景 | 模型 | -|---|---| -| Classification | [PaddleClas](../examples/vision/classification/paddleclas/serving/README.md) | +| 任务场景 | 模型 | +|---|-----------------------------------------------------------------------------------| +| Classification | [PaddleClas](../examples/vision/classification/paddleclas/serving/README.md) | | Detection | [PaddleDetection](../examples/vision/detection/paddledetection/serving/README.md) | -| Detection | [ultralytics/YOLOv5](../examples/vision/detection/yolov5/serving/README.md) | -| NLP | [PaddleNLP/ERNIE-3.0](../examples/text/ernie-3.0/serving/README.md)| -| NLP | [PaddleNLP/UIE](../examples/text/uie/serving/README.md)| -| Speech | [PaddleSpeech/PP-TTS](../examples/audio/pp-tts/serving/README.md)| -| OCR | [PaddleOCR/PP-OCRv3](../examples/vision/ocr/PP-OCRv3/serving/README.md)| +| Detection | [ultralytics/YOLOv5](../examples/vision/detection/yolov5/serving/README.md) | +| NLP | [PaddleNLP/ERNIE-3.0](../examples/text/ernie-3.0/serving/README.md) | +| NLP | [PaddleNLP/UIE](../examples/text/uie/serving/README.md) | +| Speech | [PaddleSpeech/PP-TTS](../examples/audio/pp-tts/serving/README.md) | +| OCR | [PaddleOCR/PP-OCRv3](../examples/vision/ocr/PP-OCR/serving/fastdeploy_serving/README.md) |