Files
FastDeploy/examples/runtime/README.md
charl-u 1135d33dd7 [Doc]Add English version of documents in examples/ (#1042)
* 第一次提交

* 补充一处漏翻译

* deleted:    docs/en/quantize.md

* Update one translation

* Update en version

* Update one translation in code

* Standardize one writing

* Standardize one writing

* Update some en version

* Fix a grammer problem

* Update en version for api/vision result

* Merge branch 'develop' of https://github.com/charl-u/FastDeploy into develop

* Checkout the link in README in vision_results/ to the en documents

* Modify a title

* Add link to serving/docs/

* Finish translation of demo.md

* Update english version of serving/docs/

* Update title of readme

* Update some links

* Modify a title

* Update some links

* Update en version of java android README

* Modify some titles

* Modify some titles

* Modify some titles

* modify article to document

* update some english version of documents in examples

* Add english version of documents in examples/visions

* Sync to current branch

* Add english version of documents in examples
2023-01-06 09:35:12 +08:00

1.8 KiB
Executable File

English | 简体中文

FastDeploy Runtime examples

FastDeploy Runtime examples are as follows:

Python Example

Example Code Program Language Description
python/infer_paddle_paddle_inference.py Python Deploy Paddle model with Paddle Inference(CPU/GPU)
python/infer_paddle_tensorrt.py Python Deploy Paddle model with TensorRT(GPU)
python/infer_paddle_openvino.py Python Deploy Paddle model with OpenVINO(CPU)
python/infer_paddle_onnxruntime.py Python Deploy Paddle model with ONNX Runtime(CPU/GPU)
python/infer_onnx_openvino.py Python Deploy ONNX model with OpenVINO(CPU)
python/infer_onnx_tensorrt.py Python Deploy ONNX model with TensorRT(GPU)
python/infer_onnx_onnxruntime.py Python Deploy ONNX model with ONNX Runtime(CPU/GPU)
python/infer_torchscript_poros.py Python Deploy TorchScript model with Poros Runtime(CPU/GPU)

C++ Example

Example Code Program Language Description
cpp/infer_paddle_paddle_inference.cc C++ Deploy Paddle model with Paddle Inference(CPU/GPU)
cpp/infer_paddle_tensorrt.cc C++ Deploy Paddle model with TensorRT(GPU)
cpp/infer_paddle_openvino.cc C++ Deploy Paddle model with OpenVINO(CPU
cpp/infer_paddle_onnxruntime.cc C++ Deploy Paddle model with ONNX Runtime(CPU/GPU)
cpp/infer_onnx_openvino.cc C++ Deploy ONNX model with OpenVINO(CPU)
cpp/infer_onnx_tensorrt.cc C++ Deploy ONNX model with TensorRT(GPU)
cpp/infer_onnx_onnxruntime.cc C++ Deploy ONNX model with ONNX Runtime(CPU/GPU)
cpp/infer_torchscript_poros.cc C++ Deploy TorchScript model with Poros Runtime(CPU/GPU)

Detailed deployment documents