mirror of
https://github.com/PaddlePaddle/FastDeploy.git
synced 2025-10-06 09:07:10 +08:00

* add paddle_trt in benchmark * update benchmark in device * update benchmark * update result doc * fixed for CI * update python api_docs * update index.rst * add runtime cpp examples * deal with comments * Update infer_paddle_tensorrt.py * Add runtime quick start * deal with comments Co-authored-by: Jason <928090362@qq.com>
FastDeploy Runtime examples
Example Code | Program Language | Description |
---|---|---|
python/infer_paddle_paddle_inference.py | Python | Deploy Paddle model with Paddle Inference(CPU/GPU) |
python/infer_paddle_tensorrt.py | Python | Deploy Paddle model with TensorRT(GPU) |
python/infer_paddle_openvino.py | Python | Deploy Paddle model with OpenVINO(CPU) |
python/infer_paddle_onnxruntime.py | Python | Deploy Paddle model with ONNX Runtime(CPU/GPU) |
python/infer_onnx_openvino.py | Python | Deploy ONNX model with OpenVINO(CPU) |
python/infer_onnx_tensorrt.py | Python | Deploy ONNX model with TensorRT(GPU) |
cpp/infer_paddle_paddle_inference.cc | C++ | Deploy Paddle model with Paddle Inference(CPU/GPU) |
cpp/infer_paddle_tensorrt.cc | C++ | Deploy Paddle model with TensorRT(GPU) |
cpp/infer_paddle_openvino.cc | C++ | Deploy Paddle model with OpenVINO(CPU |
cpp/infer_paddle_onnxruntime.cc | C++ | Deploy Paddle model with ONNX Runtime(CPU/GPU) |
cpp/infer_onnx_openvino.cc | C++ | Deploy ONNX model with OpenVINO(CPU) |
cpp/infer_onnx_tensorrt.cc | C++ | Deploy ONNX model with TensorRT(GPU) |