██████╗  █████╗ ███╗   ██╗██╗  ██╗██╗███████╗██╗   ██╗
██╔══██╗██╔══██╗████╗  ██║██║ ██╔╝██║██╔════╝╚██╗ ██╔╝
██████╔╝███████║██╔██╗ ██║█████╔╝ ██║█████╗   ╚████╔╝ 
██╔══██╗██╔══██║██║╚██╗██║██╔═██╗ ██║██╔══╝    ╚██╔╝  
██║  ██║██║  ██║██║ ╚████║██║  ██╗██║██║        ██║   
╚═╝  ╚═╝╚═╝  ╚═╝╚═╝  ╚═══╝╚═╝  ╚═╝╚═╝╚═╝        ╚═╝   
                                                        
 █████╗ ███████╗███████╗██╗███████╗████████╗          
██╔══██╗██╔════╝██╔════╝██║██╔════╝╚══██╔══╝          
███████║███████╗███████╗██║███████╗   ██║             
██╔══██║╚════██║╚════██║██║╚════██║   ██║             
██║  ██║███████║███████║██║███████║   ██║             
╚═╝  ╚═╝╚══════╝╚══════╝╚═╝╚══════╝   ╚═╝             

🎯 Your Voice. Your Browser. Your Smart Home. One Command.

Tuya AI Innovators Hackathon 2025 — AI Agent Development Track

---

🎬 Demo Video

📺 ▶️ Watch the Full Demo on YouTube

1–3 minute walkthrough of Rankify Assist: voice commands, browser automation, smart home control, and the safety-first confirmation system.

#TuyaOpen #TuyaAI #HackWithTuya #TuyaHackathon #TuyaDevelopers #TuyaGlobal

---

👨‍💻 Team Introduction

	Details
Team Name	Rankify AI
Project Name	Rankify Assist
Track	AI Agent Development
Developer	Naman Dhakad — Solo developer, full-stack AI & IoT engineer

---

---

Transform your voice into browser automation and smart home control
Built with safety-first architecture • Powered by Tuya AI • 100% Open Source

🚀 Quick Start • 📖 Documentation • 🏗️ Architecture • 🎬 Demo

---

🎯 Problems Addressed & Target Users

The Problem

Today's voice assistants (Alexa, Google Home, Siri) are limited to predefined skills and cannot:

• ❌ Automate real browser tasks (checking emails, filling forms, web searches)
• ❌ Provide safety confirmation before executing critical actions
• ❌ Bridge IoT device control with web automation in a single unified interface
• ❌ Let users add custom automation without programming knowledge

Our Solution

Rankify Assist is the first voice AI system that combines browser automation, smart home control, and conversational AI with a mandatory safety-first confirmation protocol — all powered by the Tuya T5-E1 development board and TuyaOpen platform.

Target Users

User Segment	Use Case
🧑‍💻 Productivity Workers	Hands-free email checking, web searches, form filling
🏠 Smart Home Owners	Unified voice control for all Tuya-compatible devices
♿ Accessibility Users	Voice-first interface for differently-abled individuals
🔧 Developers & Makers	Extensible open-source platform to build custom AI hardware
🏢 Enterprise Teams	Secure, confirmation-based automation for sensitive operations

---

🌟 What Makes It Special

🌐 Browser Magic Voice → Action "Check my Gmail" ↓ 🔒 Safety Check ↓ ✅ You Approve ↓ 🌐 Browser Opens ↓ 📊 "5 Unread Emails" 100% Safe! Never executes without permission

🏠 Smart Home Voice → Instant "Turn on lights" ↓ ⚡ Instant Execution ↓ 💡 Lights On ↓ ✅ "Done!" Lightning Fast! No confirmation needed

💬 AI Chat Voice → Answer "What's 2+2?" ↓ 🧠 AI Thinks ↓ 💭 "It's 4" ↓ 🔊 Voice Response Contextual! Remembers conversation

---

✨ Features That WOW

Feature	Description	Status
🎤	Voice Control - Natural language commands via SmartLife app	✅
🔒	Safety First - Explicit confirmation for ALL browser actions	✅
🌐	Browser Automation - Gmail, YouTube, Google Search, any site!	✅
💡	Smart Home - Control lights, AC, locks, any Tuya device	✅
🧠	Conversational AI - Chat with memory and context	✅
👥	Multi-User - Google OAuth authentication	✅
☁️	Cloud Native - Always-on Vercel + Supabase	✅
💰	100% FREE - Zero cost deployment	✅
🔓	Open Source - MIT License, all code included	✅

---

🎬 See It In Action

🌐 Browser Automation Flow

graph LR
    A[👤 You<br/>"Check Gmail"] --> B[🧠 AI Plans<br/>Browser Task]
    B --> C[🔊 AI Asks<br/>"Proceed?"]
    C -->|You: "Yes"| D[🌐 Browser Opens]
    C -->|You: "No"| E[❌ Cancelled]
    D --> F[📊 Result<br/>"5 Unread"]
    F --> G[🔊 AI Speaks<br/>Result]
    
    style A fill:#e1f5ff,stroke:#01579b,stroke-width:3px
    style C fill:#fff3e0,stroke:#e65100,stroke-width:3px
    style D fill:#e8f5e9,stroke:#2e7d32,stroke-width:3px
    style E fill:#ffebee,stroke:#c62828,stroke-width:3px
    style G fill:#f3e5f5,stroke:#4a148c,stroke-width:3px

Loading

🏠 Smart Home Flow

graph LR
    A[👤 You<br/>"Turn on lights"] --> B[🧠 AI<br/>Recognizes]
    B --> C[⚡ Instant<br/>Execution]
    C --> D[💡 Lights<br/>Turn On]
    D --> E[🔊 AI Confirms<br/>"Done!"]
    
    style A fill:#e1f5ff,stroke:#01579b,stroke-width:3px
    style C fill:#fff3e0,stroke:#ff6f00,stroke-width:3px
    style D fill:#e8f5e9,stroke:#2e7d32,stroke-width:3px
    style E fill:#f3e5f5,stroke:#4a148c,stroke-width:3px

Loading

---

🏗️ Architecture

┌─────────────────────────────────────────────────────────┐
│                  🎤 SMARTLIFE APP                       │
│              "Your Voice Commands Here"                 │
└────────────────────┬────────────────────────────────────┘
                     │
                     ↓
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃          ☁️  TUYA AI WORKFLOW (Cloud)                  ┃
┃  ┌──────────────┬──────────────┬──────────────┐        ┃
┃  │ 🧠 Intent    │ 🌐 Browser   │ 🏠 IoT       │        ┃
┃  │ Recognition  │ Planner      │ Controller   │        ┃
┃  └──────────────┴──────────────┴──────────────┘        ┃
┗━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━┛
                     │           │
        ┌────────────┴───┐   ┌───┴────────────┐
        ↓                ↓   ↓                ↓
┌────────────────┐ ┌────────────────┐ ┌────────────────┐
│ 🐍 Browser MCP │ │ 🐍 Device MCP  │ │ 💬 Chat        │
│ (Your PC)      │ │ (Your PC)      │ │ Direct Response│
└───────┬────────┘ └────────┬───────┘ └────────────────┘
        │                   │
        ↓                   ↓
┌────────────────┐ ┌────────────────┐
│ 🚀 Vercel      │ │ 🔌 Tuya API    │
│ Cloud Bridge   │ │ Smart Devices  │
└───────┬────────┘ └────────────────┘
        │
        ↓
┌────────────────┐
│ 🧩 Chrome Ext  │
│ Your Browser   │
└────────────────┘

🎯 Design Philosophy: Local MCP Servers + Cloud Bridge = Zero Cost + Maximum Control

---

🚀 Quick Start (30 Minutes)

🎯 4 Simple Steps to Voice-Controlled Everything

1️⃣ ☁️ Cloud Deploy Supabase ↓ Deploy Vercel ↓ Set Env Vars ⏱️ 10 mins

2️⃣ 🧩 Extension pnpm install ↓ pnpm build ↓ Load in Chrome ⏱️ 5 mins

3️⃣ 🐍 MCPs Install SDK ↓ Configure .env ↓ Run Servers ⏱️ 10 mins

4️⃣ 🎤 Test Say Command ↓ Confirm ↓ Watch Magic! ⏱️ 5 mins

📖 Detailed Guide →

---

💎 Technology Stack

Powered by Best-in-Class Technologies

AI Engine

MCP Servers

Cloud API

Database

Extension

LLM Engine

Authentication

UI Framework

MCP Protocol

---

💰 Pricing (Spoiler: It's FREE!)

Service	Free Tier	Your Usage	Monthly Cost
🗄️ Supabase	500MB DB, ∞ Requests	~10MB	$0
🚀 Vercel	100k Serverless Calls	~1k	$0
🔌 Tuya IoT	1000 API Calls/Day	~50/day	$0
🐍 MCP Servers	Offline & Online	~ no limit	$0
🧩 Extension	Chrome Only	Browser	$0
💎 TOTAL			$0/month

🎉 Yes, Forever FREE!

---

🧪 Try These Commands

🌐 Browser Commands	🏠 Smart Home	💬 Chat
✅ "Check my Gmail" ✅ "Open YouTube" ✅ "Search for AI news" ✅ "Go to Twitter" ✅ "Find pizza near me"	✅ "Turn on lights" ✅ "Set AC to 22°" ✅ "Lock front door" ✅ "Dim bedroom lights" ✅ "Turn off all devices" Instant execution! ⚡	✅ "What's 2+2?" ✅ "Tell me a joke" ✅ "What's the weather?" ✅ "Explain quantum physics" ✅ "Help me plan dinner" Natural conversation! 💭

---

🔧 Hardware List

#	Component	Exact Model	Purpose	Status
1	AI Core Board	Tuya T5-E1 AI Core Development Board	Voice capture, STT/TTS, cloud connectivity, DP management	✅
2	Microphone	Built-in 2-mic array (on T5-E1)	Voice input capture	✅
3	Speaker	Built-in 3W speaker (on T5-E1)	TTS audio output	✅
4	USB Cable	USB-C data cable	Firmware flashing & power	✅
5	Wi-Fi Router	Any 2.4GHz WPA2 router	Cloud connectivity	✅
6	Development PC	Windows 11 laptop	MCP servers, Chrome Extension, firmware build	✅
7	Smart Bulb (optional)	Any Tuya-compatible Wi-Fi LED bulb	IoT control demonstration	Optional
8	Smart Plug (optional)	Any Tuya-compatible Wi-Fi smart socket	Generic device control testing	Optional

Hardware Connection Diagram

┌─────────────────────────────────────────────────────────────┐
│                    👤 USER (Voice)                          │
└───────────────────────┬─────────────────────────────────────┘
                        │ speaks
                        ▼
┌─────────────────────────────────────────────────────────────┐
│              🎙️ TUYA T5-E1 AI CORE BOARD                    │
│  ┌─────────────┐  ┌──────────────┐  ┌──────────────────┐   │
│  │ 2-Mic Array │→ │ Audio DSP    │→ │ Wi-Fi 2.4/5GHz   │   │
│  │ (Voice In)  │  │ (Processing) │  │ (Cloud Connect)  │   │
│  └─────────────┘  └──────────────┘  └────────┬─────────┘   │
│  ┌─────────────┐                              │             │
│  │ 3W Speaker  │← TTS Output                 │             │
│  │ (Audio Out) │                              │             │
│  └─────────────┘                              │             │
│  ┌─────────────┐                              │             │
│  │ USB-C Port  │← Firmware Flash / Power      │             │
│  └──────┬──────┘                              │             │
└─────────┼─────────────────────────────────────┼─────────────┘
          │                                     │
          │ USB-C Cable                         │ Wi-Fi (2.4GHz)
          ▼                                     ▼
┌──────────────────┐              ┌──────────────────────────┐
│ 💻 DEVELOPMENT PC │              │    🌐 WI-FI ROUTER       │
│ • MCP Servers    │              │    (Internet Gateway)    │
│ • Chrome + Ext   │              └────────────┬─────────────┘
│ • Firmware Build │                           │
└──────────────────┘                           ▼
                                  ┌──────────────────────────┐
                                  │   ☁️ TUYA CLOUD PLATFORM  │
                                  │  • AI Workflow Engine    │
                                  │  • STT/TTS Services      │
                                  │  • Device Management     │
                                  │  • MCP Gateway           │
                                  └────────────┬─────────────┘
                                               │
                                  ┌────────────┴─────────────┐
                                  ▼                          ▼
                        ┌──────────────────┐    ┌──────────────────┐
                        │ 💡 Smart Bulb     │    │  🔌 Smart Plug    │
                        │ (Tuya Wi-Fi)     │    │  (Tuya Wi-Fi)    │
                        └──────────────────┘    └──────────────────┘

---

📊 Project Stats

---

📂 Repository Structure

┌─ RankifyAssist
│
├─📁 cloud-bridge/          🚀 Vercel serverless API
│  ├─ api/                  ├─ /execute, /poll, /result, /auth
│  ├─ lib/                  ├─ Supabase client, auth helpers
│  ├─ public/               └─ Admin UI (config management)
│  └─ supabase-schema.sql   📝 Database schema
│
├─📁 mcp-servers/           🐍 Python MCP servers (local files & HuggingFace online)
│  ├─ browser-automation/   ├─ WebSocket to Tuya Gateway
│  └─ device-controller/    └─ Calls Tuya OpenAPI
│
├─📁 extension-raw/         🧩 Chrome extension source
│  ├─ chrome-extension/     ├─ Background scripts
│  └─ pages/                └─ Options UI, Side panel
│
├─📁 firmware/              💻 T5 AI Core firmware (optional if u want own modification)
│  ├─ src/                  ├─ Voice input, TTS output
│  └─ include/              └─ Device configuration
│
└─📁 docs/                  📖 Complete documentation
   ├─ deployment/           ├─ Quick start guides
   ├─ cloud-bridge/         ├─ Infrastructure docs
   ├─ mcp/                  ├─ MCP setup
   ├─ extension/            ├─ Build guides
   └─ workflow/             └─ Tuya AI configuration

---

🎓 Learning Resources

📚 Topic	🔗 Link	⏱️ Time
Quick Start	Deploy in 30 mins	30m
Architecture	System Design	15m
MCP Setup	Configure MCPs	20m
Extension	Build Guide	10m
Workflow	Tuya Configuration	25m
Checklist	Pre-commit	5m

---

🛡️ Security & Privacy

🔒 Safety-First Design

Feature	Implementation	Status
🔐 Single ID Access	A single MCP Access ID connects whole mcp->server->database->extension	✅
🔑 OAuth Authentication	Google OAuth 2.0 for secure login	✅
🗄️ Encrypted Storage	Supabase RLS policies + encrypted credentials	✅
🚫 No Data Collection	Zero telemetry, zero tracking	✅
🔓 Open Source	Full code transparency	✅

---

📐 Design Principles

1. Safety-First Architecture

Every browser action requires explicit voice confirmation before execution. The system announces its plan ("I plan to open Gmail. Proceed?") and waits for the user to say "Yes" or "No". This prevents accidental or misinterpreted voice commands from causing unwanted actions.

2. Hybrid Cloud-Edge Design

• Edge (T5-E1 Board): Voice I/O, local keyword detection, TTS playback
• Cloud (Tuya Platform): AI intent classification, workflow orchestration, LLM processing
• Client (Chrome Extension): Browser automation execution via Eko Agent
• MCP Servers (Local PC): Secure bridge between Tuya Cloud and local resources

3. Zero-Cost Deployment

Designed to run entirely on free tiers: Supabase (database), Vercel (serverless API), Tuya Cloud (AI workflow), and local MCP servers — making it accessible to developers worldwide.

4. Modular & Extensible

The visual workflow editor on Tuya Platform allows adding new intents (calendar, e-commerce, file management) without code changes. Each component (firmware, extension, MCP server) is independently deployable.

System Architecture Diagram

graph TB
    subgraph USER["👤 User"]
        Voice["🎤 Voice Command"]
    end
    
    subgraph HARDWARE["🎙️ Tuya T5-E1 Board"]
        Mic["Mic Array"] --> DSP["Audio DSP"]
        DSP --> WiFi["Wi-Fi Module"]
        TTS["TTS Speaker"]
    end
    
    subgraph CLOUD["☁️ Tuya Cloud Platform"]
        STT["STT Engine"] --> Workflow["AI Workflow"]
        Workflow --> Intent{"Intent Router"}
        Intent -->|Browser| BrowserLLM["Browser LLM"]
        Intent -->|IoT| IoTCtrl["IoT Controller"]
        Intent -->|Chat| ChatLLM["Chat LLM"]
        MCP_GW["MCP Gateway"]
    end
    
    subgraph LOCAL["💻 Developer PC"]
        BrowserMCP["🐍 Browser MCP Server"]
        DeviceMCP["🐍 Device MCP Server"]
        Bridge["🚀 Vercel Cloud Bridge"]
        Ext["🧩 Chrome Extension"]
    end
    
    subgraph DEVICES["🏠 Smart Devices"]
        Bulb["💡 Smart Bulb"]
        Plug["🔌 Smart Plug"]
    end
    
    Voice --> Mic
    WiFi --> STT
    BrowserLLM --> MCP_GW
    MCP_GW <--> BrowserMCP
    MCP_GW <--> DeviceMCP
    BrowserMCP --> Bridge --> Ext
    DeviceMCP --> IoTCtrl
    IoTCtrl --> Bulb
    IoTCtrl --> Plug
    ChatLLM --> TTS
    Ext -->|Result| Bridge --> BrowserMCP --> MCP_GW --> TTS
    TTS --> Voice

Loading

---

🤝 Contributing

We ❤️ Contributions!

graph LR
    A[🍴 Fork Repo] --> B[🌿 Create Branch]
    B --> C[✏️ Make Changes]
    C --> D[✅ Test Locally]
    D --> E[📝 Commit]
    E --> F[🚀 Push]
    F --> G[📬 Pull Request]
    G --> H[🎉 Merged!]
    
    style A fill:#e3f2fd
    style H fill:#c8e6c9

Loading

---

📜 License

Free to use, modify, and distribute

View License

---

🙏 Credits & Thanks

AI Workflow Engine

Cloud Infrastructure

Serverless Platform

Firmware Framework

---

🚀 Ready to Start?

Transform Your Voice Into Action Today!

📖 Quick Start Guide • 🏗️ Architecture • 📚 Full Docs

---

_{Built with ❤️ by the Rankify Assist Team}

_{⭐ Star this repo if you find it useful! ⭐}

---