InftyAI

All

14 repositories

Awesome-LLMOps
Public
🎉 An awesome & curated list of best LLMOps tools.
awesome ai awesome-list
awesome ai awesome-list llm llmops ai-developer-tools
Python
•
Apache License 2.0
•41•215•4•5•Updated Mar 16, 2026Mar 16, 2026
alphatrion
Public
⚒️ The observability platform for agentic systems.
observability ai-applications ai-agent
observability ai-applications ai-agent llmops
Python
•
Apache License 2.0
•5•13•18•1•Updated Mar 15, 2026Mar 15, 2026
Quintessa
Public
👾 The AI-driven Agentic Operation System.
Apache License 2.0
•0•0•0•0•Updated Mar 6, 2026Mar 6, 2026
llmaz
Public
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
kubernetes inference huggingface
kubernetes inference huggingface llm modelscope llamacpp vllm text-generation-inference ollama sglang
Go
•
Apache License 2.0
•45•292•39•13•Updated Jan 26, 2026Jan 26, 2026
.github
Public
Apache License 2.0
•1•0•0•0•Updated Jan 11, 2026Jan 11, 2026
AMRS
Public
🧬 The adaptive model routing system for exploration and exploitation.
sdk llm llmops
sdk llm llmops ai-gateway ai-proxy
Rust
•
MIT License
•4•22•2•0•Updated Jan 4, 2026Jan 4, 2026
website
Public
Website and Blogs.
blog website
blog website
HTML
•
MIT License
•1•1•1•0•Updated Dec 29, 2025Dec 29, 2025
omnistore
Public
🎯 An unified python client to communicate with various kinds of object-store providers.
python oss s3
python oss s3 gcs minio object-store
Python
•
MIT License
•3•3•3•0•Updated Nov 18, 2025Nov 18, 2025
template-repo
Public template
A template repo.
Apache License 2.0
•1•0•0•0•Updated Sep 19, 2025Sep 19, 2025
karpenter
Public
This is a fork of Karpenter focused on GPU scaling with llmaz.
Go
•
Apache License 2.0
•452•0•1•0•Updated Jun 18, 2025Jun 18, 2025
scheduler-plugins
Public
Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.
Go
•
Apache License 2.0
•3•11•1•0•Updated Jun 16, 2025Jun 16, 2025
community
Public
The InftyAI community.
Apache License 2.0
•1•0•1•0•Updated Apr 18, 2025Apr 18, 2025
Manta
Public archive
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
kubernetes distributed-systems cache
kubernetes distributed-systems cache p2p-network llm
Go
•
Apache License 2.0
•3•26•14•1•Updated Dec 6, 2024Dec 6, 2024
PR-Copilot
Public archive
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛
Python
•
MIT License
•3•3•2•0•Updated Jun 29, 2024Jun 29, 2024