This is an interface of asynchronous infer request. More...
#include <ie_iinfer_request.hpp>
Public Types | |
enum | WaitMode : int64_t { RESULT_READY = -1 , STATUS_ONLY = 0 } |
Enumeration to hold wait mode for IInferRequest. More... | |
using | Ptr = std::shared_ptr< IInferRequest > |
A shared pointer to the IInferRequest object. | |
using | WeakPtr = std::weak_ptr< IInferRequest > |
A smart pointer to the IInferRequest object. | |
typedef void(* | CompletionCallback) (InferenceEngine::IInferRequest::Ptr context, InferenceEngine::StatusCode code) |
Completion callback definition as pointer to a function. More... | |
Public Member Functions | |
virtual StatusCode | SetBlob (const char *name, const Blob::Ptr &data, ResponseDesc *resp) noexcept=0 |
Sets input/output data to infer. More... | |
virtual StatusCode | GetBlob (const char *name, Blob::Ptr &data, ResponseDesc *resp) noexcept=0 |
Gets input/output data for inference. More... | |
virtual StatusCode | SetBlob (const char *name, const Blob::Ptr &data, const PreProcessInfo &info, ResponseDesc *resp) noexcept=0 |
Sets pre-process for input data. More... | |
virtual StatusCode | GetPreProcess (const char *name, const PreProcessInfo **info, ResponseDesc *resp) const noexcept=0 |
Gets pre-process for input data. More... | |
virtual StatusCode | Infer (ResponseDesc *resp) noexcept=0 |
Infers specified input(s) in synchronous mode. More... | |
virtual StatusCode | Cancel (ResponseDesc *resp) noexcept=0 |
Cancels current async inference request. More... | |
virtual StatusCode | GetPerformanceCounts (std::map< std::string, InferenceEngineProfileInfo > &perfMap, ResponseDesc *resp) const noexcept=0 |
Queries performance measures per layer to get feedback of what is the most time consuming layer. More... | |
virtual InferenceEngine::StatusCode | Wait (int64_t millis_timeout, ResponseDesc *resp) noexcept=0 |
Waits for the result to become available. Blocks until specified millis_timeout has elapsed or the result becomes available, whichever comes first. More... | |
virtual StatusCode | StartAsync (ResponseDesc *resp) noexcept=0 |
Starts inference of specified input(s) in asynchronous mode. More... | |
virtual StatusCode | SetCompletionCallback (CompletionCallback callback) noexcept=0 |
Sets a callback function that will be called on success or failure of asynchronous request. More... | |
virtual StatusCode | GetUserData (void **data, ResponseDesc *resp) noexcept=0 |
Gets arbitrary data for the request and stores a pointer to a pointer to the obtained data. More... | |
virtual StatusCode | SetUserData (void *data, ResponseDesc *resp) noexcept=0 |
Sets arbitrary data for the request. More... | |
virtual InferenceEngine::StatusCode | SetBatch (int batch_size, ResponseDesc *resp) noexcept=0 |
Sets new batch size when dynamic batching is enabled in executable network that created this request. More... | |
virtual StatusCode | QueryState (IVariableState::Ptr &pState, size_t idx, ResponseDesc *resp) noexcept=0 |
Gets state control interface for given infer request. More... | |
This is an interface of asynchronous infer request.
typedef void(* InferenceEngine::IInferRequest::CompletionCallback) (InferenceEngine::IInferRequest::Ptr context, InferenceEngine::StatusCode code) |
Completion callback definition as pointer to a function.
context | Pointer to request for providing context inside callback |
code | Completion result status: InferenceEngine::OK (0) for success |
enum InferenceEngine::IInferRequest::WaitMode : int64_t |
Enumeration to hold wait mode for IInferRequest.
Enumerator | |
---|---|
RESULT_READY | Wait until inference result becomes available |
STATUS_ONLY | IInferRequest doesn't block or interrupt current thread and immediately returns inference status |
|
pure virtualnoexcept |
Cancels current async inference request.
resp | Optional: pointer to an already allocated object to contain information in case of failure |
|
pure virtualnoexcept |
Gets input/output data for inference.
name | Name of input or output blob. |
data | Reference to input or output blob. The type of Blob must match the network input precision and size. |
resp | Optional: pointer to an already allocated object to contain information in case of failure |
|
pure virtualnoexcept |
Queries performance measures per layer to get feedback of what is the most time consuming layer.
perfMap | Map of layer names to profiling information for that layer |
resp | Optional: pointer to an already allocated object to contain information in case of failure |
|
pure virtualnoexcept |
Gets pre-process for input data.
name | Name of input blob. |
info | pointer to a pointer to PreProcessInfo structure |
resp | Optional: pointer to an already allocated object to contain information in case of failure |
|
pure virtualnoexcept |
Gets arbitrary data for the request and stores a pointer to a pointer to the obtained data.
data | Pointer to a pointer to the gotten arbitrary data |
resp | Optional: a pointer to an already allocated object to contain extra information of a failure (if occurred) |
|
pure virtualnoexcept |
Infers specified input(s) in synchronous mode.
resp | Optional: pointer to an already allocated object to contain information in case of failure |
|
pure virtualnoexcept |
Gets state control interface for given infer request.
State control essential for recurrent networks
pState | reference to a pointer that receives internal states |
idx | requested index for receiving memory state |
resp | Optional: pointer to an already allocated object to contain information in case of failure |
|
pure virtualnoexcept |
Sets new batch size when dynamic batching is enabled in executable network that created this request.
batch_size | new batch size to be used by all the following inference calls for this request. |
resp | Optional: a pointer to an already allocated object to contain extra information of a failure (if occurred) |
|
pure virtualnoexcept |
Sets pre-process for input data.
name | Name of input blob. |
data | Reference to input or output blob. The type of Blob must match the network input precision and size. |
info | Preprocess info for blob. |
resp | Optional: pointer to an already allocated object to contain information in case of failure |
|
pure virtualnoexcept |
Sets input/output data to infer.
name | Name of input or output blob. |
data | Reference to input or output blob. The type of a blob must match the network input precision and size. |
resp | Optional: pointer to an already allocated object to contain information in case of failure |
|
pure virtualnoexcept |
Sets a callback function that will be called on success or failure of asynchronous request.
callback | A function to be called |
|
pure virtualnoexcept |
Sets arbitrary data for the request.
data | Pointer to a pointer to arbitrary data to set |
resp | Optional: a pointer to an already allocated object to contain extra information of a failure (if occurred) |
|
pure virtualnoexcept |
Starts inference of specified input(s) in asynchronous mode.
resp | Optional: a pointer to an already allocated object to contain extra information of a failure (if occurred) |
|
pure virtualnoexcept |
Waits for the result to become available. Blocks until specified millis_timeout has elapsed or the result becomes available, whichever comes first.
millis_timeout | Maximum duration in milliseconds to block for |
resp | Optional: a pointer to an already allocated object to contain extra information of a failure (if occurred) |