InftyAI

All

13 repositories

Awesome-LLMOps
Public
🎉 An awesome & curated list of best LLMOps tools.
awesome ai awesome-list llm llmops ai-developer-tools
Python
•
Apache License 2.0
•30•154•0•0•Updated Sep 13, 2025Sep 13, 2025
alphatrion
Public
AlphaTrion is an open-source and all-in-one platform to build LLM-powered applications and frameworks.
evaluation observability ai-applications ai-agent llmops llm-framework llmops-platform
Python
•
Apache License 2.0
•2•6•6•0•Updated Sep 13, 2025Sep 13, 2025
llmaz
Public
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
kubernetes inference huggingface llm modelscope llamacpp vllm text-generation-inference ollama sglang
Go
•
Apache License 2.0
•42•251•37•4•Updated Sep 9, 2025Sep 9, 2025
template-repo
Public template
A template repo.
Apache License 2.0
•1•0•0•0•Updated Sep 9, 2025Sep 9, 2025
.github
Public
Apache License 2.0
•1•0•0•0•Updated Aug 3, 2025Aug 3, 2025
website
Public
Website and Blogs.
blog website
HTML
•
MIT License
•1•1•2•0•Updated Jul 24, 2025Jul 24, 2025
karpenter
Public
This is a fork of Karpenter focused on GPU scaling with llmaz.
Go
•
Apache License 2.0
•340•0•1•0•Updated Jun 18, 2025Jun 18, 2025
scheduler-plugins
Public
Scheduler-Plugins maintains a list of kubernetes scheduler plugins used in InftyAI community.
Go
•
Apache License 2.0
•3•11•1•0•Updated Jun 16, 2025Jun 16, 2025
community
Public
The InftyAI community.
Apache License 2.0
•1•0•1•0•Updated Apr 18, 2025Apr 18, 2025
Manta
Public
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
kubernetes distributed-systems cache p2p-network llm
Go
•
Apache License 2.0
•3•24•14•1•Updated Dec 6, 2024Dec 6, 2024
omnistore
Public
🎯 An unified python client to communicate with various kinds of object-store providers.
python oss s3 gcs minio object-store
Python
•
MIT License
•3•2•4•1•Updated Nov 11, 2024Nov 11, 2024
llmlite
Public
🌵 A library helps to communicate with all kinds of LLMs consistently.
llmops
Python
•
MIT License
•3•19•18•0•Updated Jul 5, 2024Jul 5, 2024
PR-Copilot
Public
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛
Python
•
MIT License
•3•3•2•0•Updated Jun 29, 2024Jun 29, 2024