[Backend] Support the deployment of models which is larger than 2G in ORT and TRT backend (#514)

* support model bigger than 2G

* update code

* update code

* fix bug

* update code
This commit is contained in:
yeliang2258
2022-11-09 11:14:15 +08:00
committed by GitHub
parent d259952224
commit 8d31fe59e8
4 changed files with 35 additions and 5 deletions

View File

@@ -130,6 +130,8 @@ class TrtBackend : public BaseBackend {
std::map<std::string, int> io_name_index_;
std::string calibration_str_;
bool save_external_ = false;
std::string model_file_name_ = "";
// Sometimes while the number of outputs > 1
// the output order of tensorrt may not be same