Skip to content

Latest commit

 

History

History
60 lines (44 loc) · 1.53 KB

File metadata and controls

60 lines (44 loc) · 1.53 KB

SightCom Architecture

Overview

SightCom is a Flutter-based mobile application designed to provide AI-powered accessibility features for visually impaired individuals. The application integrates with multiple AI services and APIs to deliver real-time assistance.

Architecture Layers

Presentation Layer

  • Flutter UI widgets
  • Screen management
  • User input handling
  • Voice output (TTS)

Business Logic Layer

  • Feature controllers
  • API orchestration
  • State management
  • Error handling

Data Layer

  • API clients
  • External service integration
  • Response parsing
  • Caching mechanism

External Integrations

Clarifai API

  • Scene Description (BLIP model)
  • Color Recognition
  • Text Recognition (OCR - PaddleOCR)
  • General AI capabilities

Barcode Lookup API

  • Product information retrieval
  • Barcode scanning integration

Speech APIs

  • Speech-to-Text (on-device or cloud)
  • Text-to-Speech (flutter_tts)

Core Components

  1. CameraService: Handles camera access and image capture
  2. APIService: Manages all external API communications
  3. SpeechService: Handles both recognition and synthesis
  4. FeatureControllers: Individual feature implementations
  5. UIWidgets: Customized accessible widgets

Data Flow

User Voice Command → Speech Recognition → Feature Selection → API Call → Response Processing → Text-to-Speech Output

Performance Considerations

  • Async/await for non-blocking operations
  • Error recovery mechanisms
  • User feedback for long operations
  • Memory optimization for images