On-Device AI Framework for iOS and Android
Locanara is an on-device AI framework inspired by LangChain, purpose-built for mobile. Build, compose, and extend AI features using platform-native models — all processing happens locally on the device.
No cloud. No data leaves. Privacy by design.
Documentation: locanara.com | Blog: LangChain for Mobile, Entirely On-Device — Meet Locanara
| Engine | Description | Requirements |
|---|---|---|
| Apple Intelligence | OS-level Foundation Models | iOS 18.1+ / macOS 15.1+ (iOS 26+ / macOS 26+ recommended), Apple Silicon, 7GB+ free space |
| llama.cpp | GGUF models with Metal GPU acceleration | iOS 17+ / macOS 14+, Apple Silicon |
| CoreML | Neural Engine accelerated inference | iOS 17+ / macOS 14+, Apple Silicon |
| MLX | Apple Silicon optimized inference | macOS 14+, Apple Silicon |
| Engine | Description | Requirements |
|---|---|---|
| Gemini Nano | ML Kit GenAI (Prompt API) | Android 14+ (API 34+) |
| ExecuTorch | Meta's on-device inference runtime | Android 12+ (API 31+) |
Locanara automatically detects device capabilities and routes inference to the best available engine.
Most on-device AI SDKs give you raw model access. Locanara gives you a framework — composable chains, memory management, guardrails, and a pipeline DSL — so you can build production AI features, not just call a model.
- Simple — One-liner convenience methods for common tasks
- Chain — Configurable built-in chains with typed results
- Custom — Implement the Chain protocol for app-specific AI features
┌─────────────────────────────────────────────┐
│ Runtime Layer │
│ Agent · Session · ChainExecutor │
├─────────────────────────────────────────────┤
│ Built-in Chains │
│ Summarize · Classify · Chat · Translate · │
│ Extract · Rewrite · Proofread │
├─────────────────────────────────────────────┤
│ Composable Layer │
│ Chain · Tool · Memory · Guardrail │
├─────────────────────────────────────────────┤
│ Core Layer │
│ LocanaraModel · PromptTemplate · │
│ OutputParser · Schema │
├─────────────────────────────────────────────┤
│ DSL Layer │
│ Pipeline · PipelineStep · ModelExtensions │
├─────────────────────────────────────────────┤
│ Platform Layer │
│ FoundationLanguageModel · PromptApiModel │
├─────────────────────────────────────────────┤
│ Engine Layer │
│ InferenceRouter · LlamaCppEngine · │
│ ExecuTorchEngine · DeviceCapabilityDetector│
├─────────────────────────────────────────────┤
│ ModelManager Layer │
│ ModelManager · ModelDownloader · │
│ ModelRegistry · ModelStorage │
├─────────────────────────────────────────────┤
│ RAG Layer │
│ VectorStore · DocumentChunker · │
│ EmbeddingEngine · RAGQueryEngine │
├─────────────────────────────────────────────┤
│ Personalization Layer │
│ PersonalizationManager · FeedbackCollector │
│ PreferenceAnalyzer · PromptOptimizer │
└─────────────────────────────────────────────┘
iOS (Swift Package Manager)
https://github.com/hyodotdev/locanara
Android (Gradle)
implementation("com.locanara:locanara:1.0.0")- Chain — Composable unit of AI logic with typed input/output
- Pipeline DSL — Compose chains with compile-time type safety
- Memory — BufferMemory (last N turns) and SummaryMemory (compressed history)
- Guardrail — Input/output validation and content filtering
- Tool — External capability integration for agents
7 ready-to-use chains, each returning typed results:
| Chain | Result Type | Description |
|---|---|---|
| SummarizeChain | SummarizeResult | Text summarization |
| ClassifyChain | ClassifyResult | Text classification |
| ExtractChain | ExtractResult | Entity extraction |
| ChatChain | ChatResult | Conversational AI with memory |
| TranslateChain | TranslateResult | Language translation |
| RewriteChain | RewriteResult | Text rewriting by style |
| ProofreadChain | ProofreadResult | Grammar correction |
- InferenceEngine — Unified protocol for all inference backends
- InferenceRouter — Automatic engine selection based on device capabilities
- DeviceCapabilityDetector — Hardware detection (NPU, memory, chipset)
- MemoryManager — Intelligent memory allocation for model loading
- ModelManager — Download, load, and manage on-device models
- ModelRegistry — Available model catalog with metadata
- ModelDownloader — Background download with progress tracking
- ModelStorage — Local storage and cache management
- VectorStore — Local vector storage for embeddings
- DocumentChunker — Text splitting with configurable strategies
- EmbeddingEngine — On-device embedding generation
- RAGQueryEngine — Similarity search and context retrieval
- FeedbackCollector — Collect user feedback on AI outputs
- PreferenceAnalyzer — Learn user preferences over time
- PromptOptimizer — Adapt prompts based on user behavior
- ChainExecutor — Instrumented execution with retry and history
- Session — Stateful conversation management
- Agent — ReAct-lite autonomous agent with tools
-
apple — iOS/macOS SDK
-
android — Android SDK
-
site — Website + Documentation → locanara.com
iOS / macOS
- Minimum: iOS 17+ / macOS 14+ (llama.cpp, CoreML engines)
- Apple Intelligence: iOS 18.1+ / macOS 15.1+ (iOS 26+ / macOS 26+ recommended)
- Requires Apple Silicon (A17 Pro+ for iPhone, M1+ for Mac)
- Requires 7GB+ free storage space
- Apple Silicon device required for all engines
Android
- Minimum: Android 12+ (API 31+) for ExecuTorch engine
- Full: Android 14+ (API 34+) for Gemini Nano engine
- Device with NPU support recommended
AGPL-3.0 License — see LICENSE for details.
Built with conviction that AI should run where your data lives — on your device.