#include <requests_pool.h>

Public Member Functions
	RequestsPool (ov::CompiledModel &compiledModel, unsigned int size)

ov::InferRequest	getIdleRequest ()

void	setRequestIdle (const ov::InferRequest &request)

size_t	getInUseRequestsCount ()

bool	isIdleRequestAvailable ()

void	waitForTotalCompletion ()

std::vector< ov::InferRequest >	getInferRequestsList ()

Detailed Description

This is class storing requests pool for asynchronous pipeline

Member Function Documentation

◆ getIdleRequest()

ov::InferRequest RequestsPool::getIdleRequest ( )

Returns idle request from the pool. Returned request is automatically marked as In Use (this status will be reset after request processing completion) This function is thread safe as long as request is used only until setRequestIdle call

Returns: pointer to request with idle state or nullptr if all requests are in use.

◆ getInferRequestsList()

std::vector< ov::InferRequest > RequestsPool::getInferRequestsList ( )

Returns list of all infer requests in the pool.

Returns: list of all infer requests in the pool.

◆ getInUseRequestsCount()

size_t RequestsPool::getInUseRequestsCount ( )

Returns number of requests in use. This function is thread safe.

Returns: number of requests in use

◆ isIdleRequestAvailable()

bool RequestsPool::isIdleRequestAvailable ( )

Returns number of requests in use. This function is thread safe.

Returns: number of requests in use

◆ setRequestIdle()

void RequestsPool::setRequestIdle ( const ov::InferRequest & request )

Sets particular request to Idle state This function is thread safe as long as request provided is not used after call to this function

Parameters

request - request to be returned to idle state

◆ waitForTotalCompletion()

void RequestsPool::waitForTotalCompletion ( )

Waits for completion of every non-idle requests in pool. getIdleRequest should not be called together with this function or after it to avoid race condition or invalid state

Returns: number of requests in use

The documentation for this class was generated from the following files:

src/common/pipelines/include/pipelines/requests_pool.h
src/common/pipelines/src/requests_pool.cpp

Public Member Functions