Public Types | Public Member Functions | Protected Member Functions | Protected Attributes
InferenceEngine::IExecutableNetworkInternal Interface Reference

An internal API of executable network to be implemented by plugin,. More...

#include <ie_iexecutable_network_internal.hpp>

Inheritance diagram for InferenceEngine::IExecutableNetworkInternal:
InferenceEngine::ExecutableNetworkThreadSafeDefault

Public Types

using Ptr = std::shared_ptr< IExecutableNetworkInternal >
 A shared pointer to IExecutableNetworkInternal interface.
 

Public Member Functions

virtual void setNetworkInputs (const InputsDataMap &networkInputs)
 Sets the network inputs info. More...
 
virtual void setNetworkOutputs (const OutputsDataMap &networkOutputs)
 Sets the network outputs data. More...
 
virtual ConstOutputsDataMap GetOutputsInfo () const
 Gets the Executable network output Data node information. The received info is stored in the given Data node. More...
 
virtual ConstInputsDataMap GetInputsInfo () const
 Gets the Executable network input Data node information. The received info is stored in the given InputsDataMap object. More...
 
virtual std::shared_ptr< IInferRequestInternalCreateInferRequest ()
 Create an inference request object used to infer the network Note: the returned request will have allocated input and output blobs (that can be changed later) More...
 
virtual void Export (const std::string &modelFileName)
 Export the current created executable network so it can be used later in the Import() main API. More...
 
virtual void Export (std::ostream &networkModel)
 Export the current created executable network so it can be used later in the Import() main API. More...
 
virtual CNNNetwork GetExecGraphInfo ()
 Get executable graph information from a device. More...
 
virtual std::vector< std::shared_ptr< IVariableStateInternal > > QueryState ()
 Queries memory states. More...
 
virtual void SetPointerToPlugin (const std::shared_ptr< IInferencePlugin > &plugin)
 Sets the pointer to plugin internal. More...
 
virtual void SetConfig (const std::map< std::string, Parameter > &config)
 Sets configuration for current executable network. More...
 
virtual Parameter GetConfig (const std::string &name) const
 Gets configuration dedicated to plugin behaviour. More...
 
virtual Parameter GetMetric (const std::string &name) const
 Gets general runtime metric for dedicated hardware. More...
 
virtual std::shared_ptr< RemoteContextGetContext () const
 Gets the remote context. More...
 

Protected Member Functions

virtual std::shared_ptr< IInferRequestInternalCreateInferRequestImpl (InputsDataMap networkInputs, OutputsDataMap networkOutputs)
 Creates an inference request internal implementation. More...
 

Protected Attributes

InferenceEngine::InputsDataMap _networkInputs
 Holds information about network inputs info.
 
InferenceEngine::OutputsDataMap _networkOutputs
 Holds information about network outputs data.
 
std::shared_ptr< IInferencePlugin_plugin
 A pointer to a IInferencePlugin interface. More...
 

Detailed Description

An internal API of executable network to be implemented by plugin,.

Member Function Documentation

◆ CreateInferRequest()

virtual std::shared_ptr<IInferRequestInternal> InferenceEngine::IExecutableNetworkInternal::CreateInferRequest ( )
virtual

Create an inference request object used to infer the network Note: the returned request will have allocated input and output blobs (that can be changed later)

Returns
shared_ptr for the created request

Implemented in InferenceEngine::ExecutableNetworkThreadSafeDefault.

◆ CreateInferRequestImpl()

virtual std::shared_ptr<IInferRequestInternal> InferenceEngine::IExecutableNetworkInternal::CreateInferRequestImpl ( InputsDataMap  networkInputs,
OutputsDataMap  networkOutputs 
)
protectedvirtual

Creates an inference request internal implementation.

Note
The method is called by IExecutableNetworkInternal::CreateInferRequest as plugin-specific implementation.
Parameters
[in]networkInputsThe network inputs
[in]networkOutputsThe network outputs
Returns
A shared pointer to inference request object.

◆ Export() [1/2]

virtual void InferenceEngine::IExecutableNetworkInternal::Export ( const std::string &  modelFileName)
virtual

Export the current created executable network so it can be used later in the Import() main API.

Deprecated:
Use IExecutableNetworkInternal::Export(std::ostream& networkModel)
Parameters
modelFileName- path to the location of the exported file

◆ Export() [2/2]

virtual void InferenceEngine::IExecutableNetworkInternal::Export ( std::ostream &  networkModel)
virtual

Export the current created executable network so it can be used later in the Import() main API.

Parameters
networkModel- Reference to network model output stream

◆ GetConfig()

virtual Parameter InferenceEngine::IExecutableNetworkInternal::GetConfig ( const std::string &  name) const
virtual

Gets configuration dedicated to plugin behaviour.

Parameters
nameA config key, can be found in ie_plugin_config.hpp
Returns
A value of config corresponding to config key

◆ GetContext()

virtual std::shared_ptr<RemoteContext> InferenceEngine::IExecutableNetworkInternal::GetContext ( ) const
virtual

Gets the remote context.

Returns
A reference to a context

◆ GetExecGraphInfo()

virtual CNNNetwork InferenceEngine::IExecutableNetworkInternal::GetExecGraphInfo ( )
virtual

Get executable graph information from a device.

Returns
A network object to store executable graph information

◆ GetInputsInfo()

virtual ConstInputsDataMap InferenceEngine::IExecutableNetworkInternal::GetInputsInfo ( ) const
virtual

Gets the Executable network input Data node information. The received info is stored in the given InputsDataMap object.

Returns
inputs Reference to ConstInputsDataMap object.

◆ GetMetric()

virtual Parameter InferenceEngine::IExecutableNetworkInternal::GetMetric ( const std::string &  name) const
virtual

Gets general runtime metric for dedicated hardware.

Parameters
nameA metric name to request
Returns
A metric value corresponding to metric key

◆ GetOutputsInfo()

virtual ConstOutputsDataMap InferenceEngine::IExecutableNetworkInternal::GetOutputsInfo ( ) const
virtual

Gets the Executable network output Data node information. The received info is stored in the given Data node.

Returns
out Reference to the ConstOutputsDataMap object

◆ QueryState()

virtual std::vector<std::shared_ptr<IVariableStateInternal> > InferenceEngine::IExecutableNetworkInternal::QueryState ( )
virtual

Queries memory states.

Deprecated:
Need to implement GetVariablesInfo for ExecutableNetwork
Returns
Returns memory states

◆ SetConfig()

virtual void InferenceEngine::IExecutableNetworkInternal::SetConfig ( const std::map< std::string, Parameter > &  config)
virtual

Sets configuration for current executable network.

Parameters
configMap of pairs: (config parameter name, config parameter value)

◆ setNetworkInputs()

virtual void InferenceEngine::IExecutableNetworkInternal::setNetworkInputs ( const InputsDataMap networkInputs)
virtual

Sets the network inputs info.

Parameters
[in]networkInputsThe network inputs info

◆ setNetworkOutputs()

virtual void InferenceEngine::IExecutableNetworkInternal::setNetworkOutputs ( const OutputsDataMap networkOutputs)
virtual

Sets the network outputs data.

Parameters
[in]networkOutputsThe network outputs

◆ SetPointerToPlugin()

virtual void InferenceEngine::IExecutableNetworkInternal::SetPointerToPlugin ( const std::shared_ptr< IInferencePlugin > &  plugin)
virtual

Sets the pointer to plugin internal.

Parameters
[in]pluginThe plugin
Note
Needed to correctly handle ownership between objects.

Field Documentation

◆ _plugin

std::shared_ptr<IInferencePlugin> InferenceEngine::IExecutableNetworkInternal::_plugin
protected

A pointer to a IInferencePlugin interface.

Note
Needed to correctly handle ownership between objects.

The documentation for this interface was generated from the following file: