This repository provides a VLM microservice which is a FastAPI-based wrapping on top of OpenVINO. The microservice helps provide OpenAI API compliant microservice supporting VLMs which are not supported yet in OpenVINO model serving (OVMS).
Below, you'll find links to detailed documentation to help you get started, configure, and deploy the microservice.
-
Overview
- Overview: A high-level introduction to the microservice.
-
Getting Started
- Get Started: Step-by-step guide to getting started with the microservice.
- System Requirements: Hardware and software requirements for running the microservice.
-
Deployment
- How to Build from Source: Instructions for building the microservice from source code.
-
API Reference
- API Reference: Comprehensive reference for the available REST API endpoints.
-
Release Notes
- Release Notes: Information on the latest updates, improvements, and bug fixes.