Graph-based Knowledge Tracing: Modeling Student Proficiency Using Graph Neural Network

Adaptive Model Streaming for real-time video inference on edge devices

LM-Kit Maestro is a secure, innovative desktop application that orchestrates AI agents offline, empowering you to build personalized chatbots with the advanced capabilities of LM-Kit.NET.

[IEEE S&P 22] "LinkTeller: Recovering Private Edges from Graph Neural Networks via Influence Analysis" by Fan Wu, Yunhui Long, Ce Zhang, Bo Li

Enable efficient DNN inference on the edge

LLM chatbot example using OpenVINO with RAG (Retrieval Augmented Generation).

Source code of the paper "Private Collaborative Edge Inference via Over-the-Air Computation".

Lightweight, extensible, and fair multi- DNN manager for heterogeneous embedded devices.

Production Android AI with ExecuTorch 1.0 - Deploy PyTorch models to mobile with NPU acceleration and 50KB footprint

Flutter + LiteRT/tflite demo for obj detection

Code for paper "Dynamic Deep Neural Network Inference via Adaptive Channel Skipping"

Arbitrary Numbers

This project is a wearable navigation aid that combines computer vision, edge inference, and obstacle detection. The system provides audio feedback to assist visually impaired individuals in navigating their surroundings.

Code for Task-Oriented Communication for Multi-Device Cooperative Edge Inference, IEEE TWC, Jan. 2023.

DNN Splitting for Edge Assisted Inference with Convolutional Neural Networks

Counting currency from video using RepNet as a base model.

Computer Vision pipeline for crop and weed detection, with tools for dataset processing, data augmentation, hyperparameter optimization, and NCNN export for edge deployment.

In this project we are comparing the 7 different segmentation model to compare their number of parameters accuracy, inference time, training epochs under the same training conditions