mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-06 00:57:33 +08:00

Files

Wang Xinyu 22d91a73c6 [Serving] Add a simple Python serving (#962 )

* init simple serving

* simple serving is working

* ppyoloe demo

* Update README_CN.md

* update readme

* complete vision result to json

2022-12-26 21:09:08 +08:00

client.py

[Serving] Add a simple Python serving (#962 )

2022-12-26 21:09:08 +08:00

README_CN.md

[Serving] Add a simple Python serving (#962 )

2022-12-26 21:09:08 +08:00

README_EN.md

[Serving] Add a simple Python serving (#962 )

2022-12-26 21:09:08 +08:00

README.md

[Serving] Add a simple Python serving (#962 )

2022-12-26 21:09:08 +08:00

server.py

[Serving] Add a simple Python serving (#962 )

2022-12-26 21:09:08 +08:00

README_EN.md

English | 简体中文

PaddleDetection Python Simple Serving Demo

Environment

1. Prepare environment and install FastDeploy Python whl, refer to download_prebuilt_libraries

Server:

# Download demo code
git clone https://github.com/PaddlePaddle/FastDeploy.git
cd FastDeploy/examples/vision/detection/paddledetection/python/serving

# Download PPYOLOE model
wget https://bj.bcebos.com/paddlehub/fastdeploy/ppyoloe_crn_l_300e_coco.tgz
tar xvf ppyoloe_crn_l_300e_coco.tgz

# Install uvicorn
pip install uvicorn

# Launch server, it's configurable to use GPU and TensorRT,
# and run 'uvicorn --help' to check how to specify IP and port, etc.
# CPU
MODEL_DIR=ppyoloe_crn_l_300e_coco DEVICE=cpu uvicorn server:app
# GPU
MODEL_DIR=ppyoloe_crn_l_300e_coco DEVICE=gpu uvicorn server:app
# GPU and TensorRT
MODEL_DIR=ppyoloe_crn_l_300e_coco DEVICE=gpu USE_TRT=true uvicorn server:app

Client:

# Download demo code
git clone https://github.com/PaddlePaddle/FastDeploy.git
cd FastDeploy/examples/vision/detection/paddledetection/python/serving

# Download test image
wget https://gitee.com/paddlepaddle/PaddleDetection/raw/release/2.4/demo/000000014439.jpg

# Send request and get inference result (Please adapt the IP and port if necessary)
python client.py