AI-powered, context-aware actions at your fingertips. Literally.
Features • How It Works • Installation • Demo • Architecture
You know that feeling when you're drowning in tabs, constantly switching contexts, hunting through menus for features you know exist somewhere?
┌─────────────────────────────────────────────┐
│ Monday, 9:47 AM │
│ • 27 browser tabs open │
│ • Switched apps 184 times │
│ • Clicked through menus... so many menus │
│ • Lost in tool overload │
└─────────────────────────────────────────────┘
We've all been there. It's like living in the 90s, but with more RAM.
What if your Logitech device just knew what you needed? What if it adapted to your workflow, learned your patterns, and brought the right tools to your fingertips exactly when you need them?
A Logitech plugin that transforms your MX device into an intelligent, self-adapting command center powered by 6,000+ AI tools through the Model Context Protocol.
Switch to VS Code? Get Commit, Push, Debug, Run Tests.
Switch to Slack? Get Send Message, @Mention, React, Search.
Switch to Chrome? Get Bookmark, New Tab, History, Search.
All automatically. No configuration. No setup. Just works.
The system tracks your behavior (with your permission, always):
- Notices you run tests in VS Code 20 times a week
- Automatically adds it to your actions ring
- Hardware that adapts to YOU
Built on the Model Context Protocol — the open standard adopted by:
- ✅ OpenAI (March 2025)
- ✅ Google DeepMind (April 2025)
- ✅ Microsoft & Anthropic
- ✅ 6,480+ servers and growing
New MCP server published tomorrow? You get it automatically. No plugin updates. No configuration. It just appears.
┌─────────────────────────────────────────────────────────────────┐
│ 🔄 THE ADAPTIVE CYCLE │
└─────────────────────────────────────────────────────────────────┘
1️⃣ You switch apps → Process Monitor detects it
↓
2️⃣ Query MCP Registry → Find relevant servers
↓
3️⃣ AI suggests workflows → "Commit", "Push", "Debug"
↓
4️⃣ Actions Ring updates → Instantly available
↓
5️⃣ You click action → MCP executes the tool
↓
6️⃣ UI Monitor tracks patterns → "Hmm, they do this a lot..."
↓
7️⃣ AI interprets behavior → "User runs tests frequently"
↓
8️⃣ Vector clustering → Similar actions group together
↓
9️⃣ Frequency threshold hit → "Want to add 'Run Tests'?"
↓
🔟 Ring updated → Ring adapts permanently
♻️ REPEAT. IMPROVE. ADAPT.
┌─────────────────────────────────────────────────────┐
│ TIER 1: DISCOVERY (Instant) │
│ • MCP Registry lookup on app switch │
│ • AI suggests 6-8 common workflows │
│ • Actions Ring populates in <500ms │
└─────────────────────────────────────────────────────┘
↓
┌─────────────────────────────────────────────────────┐
│ TIER 2: OBSERVATION (Passive) │
│ • Windows UI Automation monitors clicks │
│ • Tracks focus changes, inputs, shortcuts │
│ • Stores interaction data (24-hour TTL) │
└─────────────────────────────────────────────────────┘
↓
┌─────────────────────────────────────────────────────┐
│ TIER 3: ADAPTATION (Intelligent) │
│ • Gemini AI interprets action sequences │
│ • VoyageAI embeddings cluster similar patterns │
│ • clustering algorithm identifies workflows │
└─────────────────────────────────────────────────────┘
| Layer | Technology | Why We Love It |
|---|---|---|
| 🎮 Plugin | Logitech Actions SDK (C#) | Native hardware integration |
| 🤖 AI Brain | Google Gemini | Workflow understanding & suggestions |
| 🧮 Embeddings | VoyageAI (voyage-code-3) |
Semantic similarity detection |
| 📊 Clustering | NN + Cosine Similarity | Pattern recognition |
| 👀 UI Tracking | Windows UI Automation | Behavioral learning |
| 🗄️ Storage | SQLite3 | Fast, local, private |
| 🌐 Ecosystem | Model Context Protocol | 6,000+ tools, one standard |
| Approach | Limitation | Logitum |
|---|---|---|
| Keyboard Shortcuts | Memorize 100+ combinations | ✅ Visual, contextual, max 8 at once |
| Command Palettes | Still requires typing & searching | ✅ Physical button, instant |
| Claude Desktop | Shows ALL tools, manual navigation | ✅ Shows RELEVANT tools, learns |
| Logitech Smart Actions | Manual setup, no MCP, static | ✅ Auto MCP discovery, AI-powered, adapts |
| Other Plugins | App-specific, limited scope | ✅ Universal (6k+ apps), future-proof |
- Physical Interface - Tactile, instant, no context switching
- AI-Powered - Understands context and intent
- Self-Learning - Improves with your usage
- Open Standard - MCP means infinite extensibility
- Zero Config - Works immediately, improves automatically
- Hardware: Logitech MX Master 3/4, Loupedeck CT/Live/Live S, or Razer Stream Controller
- OS: Windows 10/11 (macOS support planned)
- Software: Logitech Options+ / Loupedeck Software
- .NET: 8.0 or higher
# Clone the repo
git clone https://github.com/yourusername/logitum.git
cd logitum/AdaptiveRingPlugin
# Set up environment variables
$env:GEMINI_API_KEY="your-gemini-api-key"
$env:VOYAGEAI_API_KEY="your-voyageai-api-key"
# Build the plugin
cd src
dotnet build -c Release
# Plugin auto-deploys to:
# C:\Users\<YOU>\AppData\Local\Logi\LogiPluginService\Plugins\- Gemini: aistudio.google.com
- VoyageAI: voyageai.com
logitum/
├── AdaptiveRingPlugin/
│ ├── src/
│ │ ├── Actions/ # Command implementations
│ │ ├── Services/ # Core intelligence
│ │ │ ├── ProcessMonitor.cs # App detection
│ │ │ ├── MCPRegistryClient.cs # MCP integration
│ │ │ ├── GeminiActionSuggestor.cs # AI suggestions
│ │ │ ├── UIInteractionMonitor.cs # Behavior tracking
│ │ │ ├── SemanticWorkflowProcessor.cs # Pattern analysis
│ │ │ ├── VoyageAIClient.cs # Embeddings
│ │ │ ├── VectorClusteringService.cs # Neighrest Neighbour Clustering
│ │ │ └── ActionRankingService.cs # Smart sorting
│ │ ├── Models/ # Data structures
│ │ ├── Helpers/ # Utilities
│ │ └── Scripts/ # Python AI services
│ └── bin/Release/ # Compiled plugin
├── PLAN.md # Original hackathon plan
├── FEATURE_IMPLEMENTATION_SUMMARY.md # Technical docs
└── README.md # You are here! 👋
# Debug build
dotnet build
# Release build (optimized)
dotnet build -c Release
# Watch mode (auto-rebuild)
dotnet watch build# Unit tests
dotnet test
# Integration tests (requires hardware)
dotnet test --filter Category=Integration-- Core tables
apps → Registered applications
app_actions → MCP actions per app
mcp_servers → Known MCP registry entries
-- Intelligence tables
ui_interactions → Raw UI events (24h TTL)
semantic_workflows → AI-interpreted patterns
workflow_embeddings → Vector representations
workflow_clusters → Grouped similar actions
-- All stored locally in:
-- C:\Users\<YOU>\AppData\Local\Logitum\adaptive_ring.db✅ App names (e.g., "chrome.exe", "slack.exe")
✅ Button clicks (e.g., "clicked 'Commit'")
✅ Window titles (e.g., "Gmail - Inbox")
✅ Action sequences (e.g., "Type→Click→Submit")
❌ Passwords (masked as ******)
❌ Email/message content
❌ Browsing history URLs
❌ File paths or code
🏠 100% Local - Everything stored on your machine (and could stay there if you use a local LLM)
🔒 No Cloud Sync (unless you enable it)
🗑️ 24-Hour Auto-Delete for raw UI events
Only sent to Gemini (workflow interpretation) and VoyageAI (embeddings).
You control the API keys.
- MCP Registry integration
- Gemini AI workflow suggestions
- Windows UI Automation tracking
- Vector embedding clustering
- Adaptive action learning
- SQLite3 with Vector Embeddings
- macOS support (via NSAccessibility)
- Manual action editor UI
- Export/import action profiles
- Performance optimization (caching)
- Multi-device sync (encrypted cloud)
- Voice control integration
- Cross-app workflow automation
- Team collaboration (shared profiles)
- Logitech Marketplace submission
- Plugin SDK for custom actions
We'd love your help! Here's how:
Open an issue with:
- OS version
- Logitech device model
- Steps to reproduce
- Log files (found in
C:\Users\<YOU>\AppData\Local\Logi\LogiPluginService\Logs\)
Open an issue with the enhancement label.
Found a typo? Explanation unclear? PRs welcome!
- Logitech Actions SDK - Hardware magic
- Model Context Protocol - Open AI standard
- Google Gemini - Workflow intelligence
- VoyageAI - Semantic embeddings
- MCP Registry - Tool discovery
- The frustration of tab overload
- The vision of tangible computing
- The power of open standards
- The community of 6,000+ MCP servers
- Logitech - For making incredible hardware and opening it up to developers
- HackaTUM - For the challenge that sparked this
- MCP Community - For building the future of AI interoperability
- You - For checking out this project! 🙌
- 💬 GitHub Issues: github.com/mrsladoje/logitum/issues
- 📧 Email: mrsladoje@gmail.com
⭐ Star this repo to follow development
👀 Watch for release notifications
🔔 Subscribe to issues for discussions
