Merge pull request #1305 from wwbitejotunn/set_stream_infer-shareExData

[Backend] Set inference with extra stream and prebind output tensor with share ex data
This commit is contained in:
Jack Zhou
2023-02-14 17:08:56 +08:00
committed by GitHub
10 changed files with 177 additions and 35 deletions

View File

@@ -110,6 +110,7 @@ struct FASTDEPLOY_DECL RuntimeOption {
bool enable_multi_stream = false);
void SetExternalStream(void* external_stream);
/*
* @brief Set number of cpu threads while inference on CPU, by default it will decided by the different backends
*/