Repositories list

• LlamaEdge

  Public
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

  Rust

  •

  Apache License 2.0

  •144•1.6k•2•1•Updated Feb 8, 2026Feb 8, 2026

• llama-nexus

  Public
  A gateway service designed to manage and orchestrate OpenAI-compatible API servers with MCP support.

  mcpgatewayopenai+ 1

  mcpgatewayopenaimcp-client

  Rust

  •17•13•4•2•Updated Jan 12, 2026Jan 12, 2026

• kw-search-server

  Public
  Rust

  •0•0•0•0•Updated Sep 8, 2025Sep 8, 2025

• www

  Public
  Public website

  HTML

  •3•0•0•0•Updated Aug 5, 2025Aug 5, 2025

• docs

  Public
  JavaScript

  •

  Apache License 2.0

  •6•5•0•1•Updated Aug 5, 2025Aug 5, 2025

• chatbot-ui

  Public
  TypeScript

  •

  MIT License

  •21•25•1•0•Updated Apr 29, 2025Apr 29, 2025

• rag-api-server

  Public
  A RAG API server written in Rust following OpenAI specs

  rustragopenai-api

  rustragopenai-api

  Rust

  •

  Apache License 2.0

  •13•61•12•2•Updated Apr 14, 2025Apr 14, 2025

• whisper-api-server

  Public
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

  Rust

  •4•27•1•0•Updated Mar 19, 2025Mar 19, 2025

• sd-api-server

  Public
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

  Rust

  •2•25•5•0•Updated Mar 5, 2025Mar 5, 2025

• tts-api-server

  Public
  The easiest & fastest way to run customized and fine-tuned LLMs locally or on the edge

  Rust

  •2•12•1•0•Updated Mar 5, 2025Mar 5, 2025

• llamaedge-rust

  Public
  Rust API for LlamaEdge

  Rust

  •0•1•0•0•Updated Jan 13, 2025Jan 13, 2025

• stock-analyst

  Public
  Python

  •1•2•0•0•Updated Jan 13, 2025Jan 13, 2025

• github_repo_to_llm

  Public
  Python

  •1•0•0•1•Updated Jan 13, 2025Jan 13, 2025

• WavUp

  Public
  A Rust library for audio conversion

  Rust

  •1•2•0•0•Updated Jan 8, 2025Jan 8, 2025

• talktalk

  Public
  Shell

  •1•12•0•0•Updated Dec 23, 2024Dec 23, 2024

• sd-proxy-server

  Public
  Rust

  •0•2•0•0•Updated Nov 19, 2024Nov 19, 2024

• wavup-server

  Public
  Python

  •0•0•0•0•Updated Nov 18, 2024Nov 18, 2024

• search-api-server

  Public
  An extended version of the LlamaEdge API Server with web search. In development.

  Rust

  •0•5•4•0•Updated Sep 10, 2024Sep 10, 2024

• llamaedge-query-server

  Public
  An optional query server for the LlamaEdge search enabled rag-api-server.

  Rust

  •0•1•0•0•Updated Aug 29, 2024Aug 29, 2024

• workshops

  Public
  1•8•0•0•Updated Jun 20, 2024Jun 20, 2024

• Example-LlamaEdge-RAG

  Public
  This repo contains the code for demonstrating how to using LlamaEdge RAG to build a RAG app

  Rust

  •0•13•0•0•Updated May 15, 2024May 15, 2024

• tool-api-server

  Public
  Rust

  •0•2•0•0•Updated May 8, 2024May 8, 2024

• docker

  Public
  Docker image for all models

  Shell

  •

  Apache License 2.0

  •3•1•0•1•Updated May 3, 2024May 3, 2024

• qdrant

  Public
  Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

  Rust

  •

  Apache License 2.0

  •2.1k•0•0•0•Updated Feb 22, 2024Feb 22, 2024

• scalable-server

  Public
  Shell

  •0•5•0•0•Updated Feb 8, 2024Feb 8, 2024