❤️ openOrchestrate 🗪

░░░▒▒▒▓▓▓ LOCAL AI THAT WORKS. ▓▓▓▒▒▒░░░

---

Est. 2025 | Powered by llama.cpp | Built on Caffeine & Principles

---

📸 SCREENSHOTS

First Time Setup Wizard

Chat Interface

---

📰 LATEST HEADLINES [BREAKING] Local AI Finally Gets Proper Orchestration! [NEW!] Context Windows That Don't Silently Fail You [HOT!] VRAM Constraints? We Actually Respect Those Here

🎯 QUICK STATS Codebase......... 354,000+ chars Models Supported. Works best with instruct tuned models* Cloud Deps....... 0 Telemetry........ 0 Working Paths.... SACRED *if llama.cpp supports it

---

🌟 ▂▃▅▇█ WHAT IS THIS █▇▅▃▂ 🌟

openOrchestrate is a complete Local-First MoE AI Front-End built with phpDesktop-Chrome and llama.cpp.

Not just a chat UI. An orchestration layer that:

• Routes requests intelligently
• Manages multiple GGUF models
• Preserves long-term context
• Degrades gracefully on constrained hardware

Built for people who want local AI that respects limited VRAM, limited context, and reality itself.

---

🎪 FEATURES THAT ACTUALLY WORK

🧠 INTELLIGENT MODEL ROUTING

╔════════════════════════════════════════╗
║  Query → Router → Right Model          ║
║  Code   → CodeLlama                    ║
║  Medical → Meditron                    ║
║  General → Llama                       ║
╚════════════════════════════════════════╝

💾 VELOCITY INDEX (Long-Term Memory)

┌─────────────────────────────────────┐
│ Context full → ARCHIVE & INDEX      │
│              → Recall when needed   │
│              → Keep continuity      │
└─────────────────────────────────────┘

✂️ CONTEXT PRUNING

Context limits managed deliberately, not silently dropped.

🎛️ MULTI-MODEL EXECUTION

╔══════════════════════════════════════╗
║  GPU: [████████░░] Managed           ║
║  CPU: [██░░░░░░░░] Auxiliary         ║
║  VRAM: Predictable ✓                 ║
╚══════════════════════════════════════╝

🔒 100% LOCAL

┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃  ✓ No API calls                  ┃
┃  ✓ No telemetry                  ┃
┃  ✓ No cloud                      ┃
┃  ✓ Stays on YOUR machine         ┃
┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛

📎 FILE ATTACHMENTS

Attach text files for analysis.

---

☕ KEEP THE PROJECT BREWING

Fuel the development • Support more features • Keep it 100% local & independent

---

🏗️ ARCHITECTURE

        USER INTERFACE
        (HTML/CSS/JS)
              │
              ▼
       PIPELINE ENGINE
              │
     ┌────────┼────────┐
     ▼        ▼        ▼
  LLAMA   VELOCITY  CONTEXT
GOVERNOR   INDEX   PRUNING
     │
     ▼
  llama.cpp

🎯 TECH STACK

Component	Tech
Frontend	HTML/CSS/JS (~66k chars)
Backend	PHP (~40k chars)
Runtime	phpDesktop-Chrome
Inference	llama.cpp

---

🎭 SUPPORTED MODELS

╔═══════════════════════════════════════════════════╗
║  IF llama.cpp CAN RUN IT, WE CAN ORCHESTRATE IT  ║
╚═══════════════════════════════════════════════════╝

🗣️ GENERAL LLMs Gemma Phi Qwen Falcon Your custom GGUF	💻 CODE MODELS Qwen Code DeepSeek-Coder StarCoder Mistral Code
🏥 MEDICAL/RESEARCH Meditron BioMistral MedGemma	🎯 ANY GGUF If llama.cpp runs it We orchestrate it No vendor lock-in

---

🎲 DESIGN PHILOSOPHY

╔═══════════════════════════════════════════════════════╗
║  ⚡ Constraints are real                             ║
║  ⚡ Regression is failure                            ║
║  ⚡ Working paths are sacred                         ║
║  ⚡ Graceful degradation > Silent failure            ║
╚═══════════════════════════════════════════════════════╝

---

📊 STATUS

🚧 UNDER ACTIVE DEVELOPMENT - CURRENTLY VULKAN & WINDOWS ONLY!! 🚧

Focus: Stability > Features | Approach: Conservative releases

---

🎯 WHY THIS EXISTS

💾 Limited VRAM

📝 Limited Context

🤝 User Trust

🌍 Reality

Local AI deserves tooling that respects constraints.

---

🏴 MADE IN WALES

Crafted with love, discipline, and entirely too much tea.

---

┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃                                                  ┃
┃  "Finally, a local AI tool that doesn't         ┃
┃   treat me like I have a datacenter"            ┃
┃                                   — Hopefully You┃
┃                                                  ┃
┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛

💬 Got Questions? Found Bugs? Have Opinions?

Issues are welcome. PRs are reviewed. Respect is expected.

---

⬆️ BACK TO TOP

---

Last Updated: 2026 | Page Views: ∞ | Caffeine Consumed: Yes