Enhance OpenVINO async processing GPU ingestion [DO NOT MERGE]

[bhardwaj-nakul]

Description

Enhance GPU ingestion capabilities by introducing asynchronous processing and improved telemetry. The changes optimize the OpenVINO pipeline for better throughput and allow for dynamic configuration of parallel workers. This update aims to streamline GPU utilization and improve performance metrics.

Any Newly Introduced Dependencies

No new 3rd party dependencies have been introduced in this change.

How Has This Been Tested?

On dev.

Checklist:

• I agree to use the APACHE-2.0 license for my code changes.
• I have not introduced any 3rd party components incompatible with APACHE-2.0.
• I have not included any company confidential information, trade secret, password or security token.
• I have performed a self-review of my code.