apps/FastDeploy
1
0
Fork 0
mirror of https://github.com/PaddlePaddle/FastDeploy.git synced 2025-10-15 13:10:55 +08:00
Code Issues Actions 6 Packages Projects Releases Wiki Activity

Add document describes some tricks while using TensorRT backend (#343)

Browse Source 
* add tensorrt tricks doc

* add quick start
This commit is contained in:
Jason
2022-10-11 21:19:55 +08:00
committed by GitHub
parent 5328fbc861
commit 548777a283
8 changed files with 161 additions and 42 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
fastdeploy/backends/tensorrt/trt_backend.cc
View File

@@ -298,8 +298,8 @@ bool TrtBackend::Infer(std::vector<FDTensor>& inputs,
<< "TensorRT engine will be rebuilt once shape range information "
"changed, this may take lots of time, you can set a proper shape "
"range before loading model to avoid rebuilding process. refer "
"https://github.com/PaddlePaddle/FastDeploy/docs/backends/"
"tensorrt.md for more details."
"https://github.com/PaddlePaddle/FastDeploy/docs/en/faq/"
"tensorrt_tricks.md for more details."
<< std::endl;
BuildTrtEngine();
}
@@ -592,8 +592,8 @@ bool TrtBackend::CreateTrtEngineFromOnnx(const std::string& onnx_model_buffer) {
"should be noticed that FastDeploy will rebuild the engine while "
"new input shape is out of the collected shape range, this may "
"bring some time consuming problem, refer "
"https://github.com/PaddlePaddle/FastDeploy/docs/backends/"
"tensorrt.md for more details."
"https://github.com/PaddlePaddle/FastDeploy/docs/en/faq/"
"tensorrt_tricks.md for more details."
<< std::endl;
initialized_ = true;
return true;