OpenVINO Messenger AI-Assistant for an AI PC

[vinayakkamatcodes]

I am Vinayak Kamat, a final-year B.Tech Computer Science & Engineering student at I.K. Gujral Punjab Technical University, with experience in Python, NLP, RAG models, and AI deployment. I am proposing to develop a desktop AI assistant that retrieves messages from messengers like Telegram and WhatsApp using API access. The assistant will utilize Retrieval-Augmented Generation (RAG) to enhance a locally deployed Language Model (LLM) with OpenVINO, running efficiently on an AI PC’s integrated GPU. It will generate daily digests and provide context-aware responses to user queries. The project involves integrating messenger APIs, building a RAG pipeline to extract relevant information, optimizing the LLM with OpenVINO, and creating an interactive UI using Qt or ElectronJS. This solution aims to deliver a seamless and efficient AI assistant that enhances user productivity by offering insightful and concise information from message data.

[adrianboguszewski]

@DimaPastushenkov @openvino-dev-samples