AI-powered, context-aware actions at your fingertips. Literally.
Features โข How It Works โข Installation โข Demo โข Architecture
You know that feeling when you're drowning in tabs, constantly switching contexts, hunting through menus for features you know exist somewhere?
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ Monday, 9:47 AM โ
โ โข 27 browser tabs open โ
โ โข Switched apps 184 times โ
โ โข Clicked through menus... so many menus โ
โ โข Lost in tool overload โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
We've all been there. It's like living in the 90s, but with more RAM.
What if your Logitech device just knew what you needed? What if it adapted to your workflow, learned your patterns, and brought the right tools to your fingertips exactly when you need them?
A Logitech plugin that transforms your MX device into an intelligent, self-adapting command center powered by 6,000+ AI tools through the Model Context Protocol.
Switch to VS Code? Get Commit, Push, Debug, Run Tests.
Switch to Slack? Get Send Message, @Mention, React, Search.
Switch to Chrome? Get Bookmark, New Tab, History, Search.
All automatically. No configuration. No setup. Just works.
The system tracks your behavior (with your permission, always):
- Notices you run tests in VS Code 20 times a week
- Automatically adds it to your actions ring
- Hardware that adapts to YOU
Built on the Model Context Protocol โ the open standard adopted by:
- โ OpenAI (March 2025)
- โ Google DeepMind (April 2025)
- โ Microsoft & Anthropic
- โ 6,480+ servers and growing
New MCP server published tomorrow? You get it automatically. No plugin updates. No configuration. It just appears.
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ ๐ THE ADAPTIVE CYCLE โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
1๏ธโฃ You switch apps โ Process Monitor detects it
โ
2๏ธโฃ Query MCP Registry โ Find relevant servers
โ
3๏ธโฃ AI suggests workflows โ "Commit", "Push", "Debug"
โ
4๏ธโฃ Actions Ring updates โ Instantly available
โ
5๏ธโฃ You click action โ MCP executes the tool
โ
6๏ธโฃ UI Monitor tracks patterns โ "Hmm, they do this a lot..."
โ
7๏ธโฃ AI interprets behavior โ "User runs tests frequently"
โ
8๏ธโฃ Vector clustering โ Similar actions group together
โ
9๏ธโฃ Frequency threshold hit โ "Want to add 'Run Tests'?"
โ
๐ Ring updated โ Ring adapts permanently
โป๏ธ REPEAT. IMPROVE. ADAPT.
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ TIER 1: DISCOVERY (Instant) โ
โ โข MCP Registry lookup on app switch โ
โ โข AI suggests 6-8 common workflows โ
โ โข Actions Ring populates in <500ms โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ TIER 2: OBSERVATION (Passive) โ
โ โข Windows UI Automation monitors clicks โ
โ โข Tracks focus changes, inputs, shortcuts โ
โ โข Stores interaction data (24-hour TTL) โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ TIER 3: ADAPTATION (Intelligent) โ
โ โข Gemini AI interprets action sequences โ
โ โข VoyageAI embeddings cluster similar patterns โ
โ โข clustering algorithm identifies workflows โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
| Layer | Technology | Why We Love It |
|---|---|---|
| ๐ฎ Plugin | Logitech Actions SDK (C#) | Native hardware integration |
| ๐ค AI Brain | Google Gemini | Workflow understanding & suggestions |
| ๐งฎ Embeddings | VoyageAI (voyage-code-3) |
Semantic similarity detection |
| ๐ Clustering | NN + Cosine Similarity | Pattern recognition |
| ๐ UI Tracking | Windows UI Automation | Behavioral learning |
| ๐๏ธ Storage | SQLite3 | Fast, local, private |
| ๐ Ecosystem | Model Context Protocol | 6,000+ tools, one standard |
| Approach | Limitation | Logitum |
|---|---|---|
| Keyboard Shortcuts | Memorize 100+ combinations | โ Visual, contextual, max 8 at once |
| Command Palettes | Still requires typing & searching | โ Physical button, instant |
| Claude Desktop | Shows ALL tools, manual navigation | โ Shows RELEVANT tools, learns |
| Logitech Smart Actions | Manual setup, no MCP, static | โ Auto MCP discovery, AI-powered, adapts |
| Other Plugins | App-specific, limited scope | โ Universal (6k+ apps), future-proof |
- Physical Interface - Tactile, instant, no context switching
- AI-Powered - Understands context and intent
- Self-Learning - Improves with your usage
- Open Standard - MCP means infinite extensibility
- Zero Config - Works immediately, improves automatically
- Hardware: Logitech MX Master 3/4, Loupedeck CT/Live/Live S, or Razer Stream Controller
- OS: Windows 10/11 (macOS support planned)
- Software: Logitech Options+ / Loupedeck Software
- .NET: 8.0 or higher
# Clone the repo
git clone https://github.com/yourusername/logitum.git
cd logitum/AdaptiveRingPlugin
# Set up environment variables
$env:GEMINI_API_KEY="your-gemini-api-key"
$env:VOYAGEAI_API_KEY="your-voyageai-api-key"
# Build the plugin
cd src
dotnet build -c Release
# Plugin auto-deploys to:
# C:\Users\<YOU>\AppData\Local\Logi\LogiPluginService\Plugins\- Gemini: aistudio.google.com
- VoyageAI: voyageai.com
logitum/
โโโ AdaptiveRingPlugin/
โ โโโ src/
โ โ โโโ Actions/ # Command implementations
โ โ โโโ Services/ # Core intelligence
โ โ โ โโโ ProcessMonitor.cs # App detection
โ โ โ โโโ MCPRegistryClient.cs # MCP integration
โ โ โ โโโ GeminiActionSuggestor.cs # AI suggestions
โ โ โ โโโ UIInteractionMonitor.cs # Behavior tracking
โ โ โ โโโ SemanticWorkflowProcessor.cs # Pattern analysis
โ โ โ โโโ VoyageAIClient.cs # Embeddings
โ โ โ โโโ VectorClusteringService.cs # Neighrest Neighbour Clustering
โ โ โ โโโ ActionRankingService.cs # Smart sorting
โ โ โโโ Models/ # Data structures
โ โ โโโ Helpers/ # Utilities
โ โ โโโ Scripts/ # Python AI services
โ โโโ bin/Release/ # Compiled plugin
โโโ PLAN.md # Original hackathon plan
โโโ FEATURE_IMPLEMENTATION_SUMMARY.md # Technical docs
โโโ README.md # You are here! ๐
# Debug build
dotnet build
# Release build (optimized)
dotnet build -c Release
# Watch mode (auto-rebuild)
dotnet watch build# Unit tests
dotnet test
# Integration tests (requires hardware)
dotnet test --filter Category=Integration-- Core tables
apps โ Registered applications
app_actions โ MCP actions per app
mcp_servers โ Known MCP registry entries
-- Intelligence tables
ui_interactions โ Raw UI events (24h TTL)
semantic_workflows โ AI-interpreted patterns
workflow_embeddings โ Vector representations
workflow_clusters โ Grouped similar actions
-- All stored locally in:
-- C:\Users\<YOU>\AppData\Local\Logitum\adaptive_ring.dbโ
App names (e.g., "chrome.exe", "slack.exe")
โ
Button clicks (e.g., "clicked 'Commit'")
โ
Window titles (e.g., "Gmail - Inbox")
โ
Action sequences (e.g., "TypeโClickโSubmit")
โ Passwords (masked as ******)
โ Email/message content
โ Browsing history URLs
โ File paths or code
๐ 100% Local - Everything stored on your machine (and could stay there if you use a local LLM)
๐ No Cloud Sync (unless you enable it)
๐๏ธ 24-Hour Auto-Delete for raw UI events
Only sent to Gemini (workflow interpretation) and VoyageAI (embeddings).
You control the API keys.
- MCP Registry integration
- Gemini AI workflow suggestions
- Windows UI Automation tracking
- Vector embedding clustering
- Adaptive action learning
- SQLite3 with Vector Embeddings
- macOS support (via NSAccessibility)
- Manual action editor UI
- Export/import action profiles
- Performance optimization (caching)
- Multi-device sync (encrypted cloud)
- Voice control integration
- Cross-app workflow automation
- Team collaboration (shared profiles)
- Logitech Marketplace submission
- Plugin SDK for custom actions
We'd love your help! Here's how:
Open an issue with:
- OS version
- Logitech device model
- Steps to reproduce
- Log files (found in
C:\Users\<YOU>\AppData\Local\Logi\LogiPluginService\Logs\)
Open an issue with the enhancement label.
Found a typo? Explanation unclear? PRs welcome!
- Logitech Actions SDK - Hardware magic
- Model Context Protocol - Open AI standard
- Google Gemini - Workflow intelligence
- VoyageAI - Semantic embeddings
- MCP Registry - Tool discovery
- The frustration of tab overload
- The vision of tangible computing
- The power of open standards
- The community of 6,000+ MCP servers
- Logitech - For making incredible hardware and opening it up to developers
- HackaTUM - For the challenge that sparked this
- MCP Community - For building the future of AI interoperability
- You - For checking out this project! ๐
- ๐ฌ GitHub Issues: github.com/mrsladoje/logitum/issues
- ๐ง Email: mrsladoje@gmail.com
โญ Star this repo to follow development
๐ Watch for release notifications
๐ Subscribe to issues for discussions
