Files
FastDeploy/examples/runtime
WJJ1995 4858a3c4b0 [Doc] Add runtime demo in quick_start (#524)
* add paddle_trt in benchmark

* update benchmark in device

* update benchmark

* update result doc

* fixed for CI

* update python api_docs

* update index.rst

* add runtime cpp examples

* deal with comments

* Update infer_paddle_tensorrt.py

* Add runtime quick start

* deal with comments

Co-authored-by: Jason <928090362@qq.com>
2022-11-08 19:37:30 +08:00
..
2022-11-07 19:49:12 +08:00
2022-11-07 21:35:56 +08:00

FastDeploy Runtime examples

Example Code Program Language Description
python/infer_paddle_paddle_inference.py Python Deploy Paddle model with Paddle Inference(CPU/GPU)
python/infer_paddle_tensorrt.py Python Deploy Paddle model with TensorRT(GPU)
python/infer_paddle_openvino.py Python Deploy Paddle model with OpenVINO(CPU)
python/infer_paddle_onnxruntime.py Python Deploy Paddle model with ONNX Runtime(CPU/GPU)
python/infer_onnx_openvino.py Python Deploy ONNX model with OpenVINO(CPU)
python/infer_onnx_tensorrt.py Python Deploy ONNX model with TensorRT(GPU)
cpp/infer_paddle_paddle_inference.cc C++ Deploy Paddle model with Paddle Inference(CPU/GPU)
cpp/infer_paddle_tensorrt.cc C++ Deploy Paddle model with TensorRT(GPU)
cpp/infer_paddle_openvino.cc C++ Deploy Paddle model with OpenVINO(CPU
cpp/infer_paddle_onnxruntime.cc C++ Deploy Paddle model with ONNX Runtime(CPU/GPU)
cpp/infer_onnx_openvino.cc C++ Deploy ONNX model with OpenVINO(CPU)
cpp/infer_onnx_tensorrt.cc C++ Deploy ONNX model with TensorRT(GPU)