Skip to content

@vllm-project vLLM

All

    Repositories list

    47 repositories

    • vllm-gaudi

      Public
      Community maintained hardware plugin for vLLM on Intel Gaudi
      Python
      •
      Apache License 2.0
      •153•52•8•45•Updated Aug 29, 2026Aug 29, 2026

    • semantic-router

      Public
      A programmable Mixture-of-Models router for heterogeneous LLM inference
      kubernetesinferencepytorch
      kubernetesinferencepytorchtransformerguardrailsmixture-of-modelsllmvllmai-gatewaysemantic-router
      Go
      •
      Apache License 2.0
      •853•5.4k•265•110•Updated Aug 29, 2026Aug 29, 2026

    • vllm-omni

      Public
      A framework for efficient model inference with omni-modality models
      inferencepytorchtransformer
      inferencepytorchtransformerimage-generationdiffusionmodel-servingmultimodalvideo-generationaudio-generationworld-model
      Python
      •
      Apache License 2.0
      •1.6k•6.5k•724•948•Updated Aug 29, 2026Aug 29, 2026

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      amdcudainference
      amdcudainferencepytorchtransformeropenaimoellamagptmodel-serving
      Python
      •
      Apache License 2.0
      •21k•90k•2.2k•5k•Updated Aug 29, 2026Aug 29, 2026

    • agentic-api

      Public
      Stateful API logic for agentic applications using vLLM
      Rust
      •
      Apache License 2.0
      •30•91•34•12•Updated Aug 29, 2026Aug 29, 2026

    • tpu-inference

      Public
      TPU inference for vLLM, with unified JAX and PyTorch support.
      Python
      •
      Apache License 2.0
      •304•418•83•371•Updated Aug 29, 2026Aug 29, 2026

    • vllm-dashboard

      Public
      TypeScript
      •13•13•1•6•Updated Aug 29, 2026Aug 29, 2026

    • vllm-ascend

      Public
      Community maintained hardware plugin for vLLM on Ascend
      inferencetransformermodel-serving
      inferencetransformermodel-servingmlopsascendllmllmopsllm-servingvllm
      C++
      •
      Apache License 2.0
      •2.1k•2.7k•1.3k•1.5k•Updated Aug 29, 2026Aug 29, 2026

    • ci-infra

      Public
      This repo hosts code for vLLM CI & Performance Benchmark infrastructure.
      Python
      •
      Apache License 2.0
      •79•49•0•68•Updated Aug 29, 2026Aug 29, 2026

    • recipes

      Public
      Common recipes to run vLLM
      JavaScript
      •
      Apache License 2.0
      •395•996•47•126•Updated Aug 29, 2026Aug 29, 2026

    • vime

      Public
      An LLM post-training framework with vLLM for RL Scaling
      Python
      •
      Apache License 2.0
      •84•442•38•20•Updated Aug 29, 2026Aug 29, 2026

    • guidellm

      Public
      Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
      Python
      •
      Apache License 2.0
      •221•1.6k•49•16•Updated Aug 29, 2026Aug 29, 2026

    • vllm-metal

      Public
      Community maintained hardware plugin for vLLM on Apple Silicon
      Python
      •
      Apache License 2.0
      •232•1.7k•6•9•Updated Aug 29, 2026Aug 29, 2026

    • production-stack

      Public
      vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
      Python
      •
      Apache License 2.0
      •476•2.5k•102•102•Updated Aug 29, 2026Aug 29, 2026

    • afd-plugin

      Public
      vLLM plugin for attention-ffn disaggregation support
      Python
      •
      Apache License 2.0
      •37•185•18•8•Updated Aug 29, 2026Aug 29, 2026

    • llm-compressor

      Public
      Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
      compressionquantization
      compressionquantization
      Python
      •
      Apache License 2.0
      •644•3.7k•50•91•Updated Aug 28, 2026Aug 28, 2026

    • speculators

      Public
      A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
      Python
      •
      Apache License 2.0
      •203•781•43•100•Updated Aug 28, 2026Aug 28, 2026

    • vllm-xpu-kernels

      Public
      The vLLM XPU kernels for Intel GPU
      C++
      •
      Apache License 2.0
      •106•65•16•55•Updated Aug 28, 2026Aug 28, 2026

    • compressed-tensors

      Public
      A safetensors extension to efficiently store sparse quantized tensors on disk
      Python
      •
      Apache License 2.0
      •120•320•9•37•Updated Aug 27, 2026Aug 27, 2026

    • aibrix

      Public
      Cost-efficient and pluggable Infrastructure components for GenAI inference
      Go
      •
      Apache License 2.0
      •665•5k•331•52•Updated Aug 27, 2026Aug 27, 2026

    • FlashMLA

      Public
      C++
      •
      MIT License
      •1.1k•15•0•4•Updated Aug 27, 2026Aug 27, 2026

    • vllm-project.github.io

      Public
      HTML
      •132•64•4•14•Updated Aug 27, 2026Aug 27, 2026

    • flash-attention

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •3k•135•0•45•Updated Aug 26, 2026Aug 26, 2026

    • vllm-daily

      Public
      vLLM Daily Summarization of Merged PRs
      6•53•0•0•Updated Aug 26, 2026Aug 26, 2026

    • vllm-gguf-plugin

      Public
      vLLM Quantization plugin for GGUF
      Python
      •
      Apache License 2.0
      •44•44•6•19•Updated Aug 25, 2026Aug 25, 2026

    • perf-eval

      Public
      Performance benchmark & accuracy evaluation for vLLM
      Python
      •17•17•0•28•Updated Aug 25, 2026Aug 25, 2026

    • vllm-bnb-plugin

      Public
      vLLM Quantization plugin for bitsandbytes
      Python
      •
      Apache License 2.0
      •3•3•0•0•Updated Aug 24, 2026Aug 24, 2026

    • FlashKDA

      Public
      Cuda
      •
      MIT License
      •2•12•0•1•Updated Aug 21, 2026Aug 21, 2026

    • router

      Public
      A high-performance and light-weight router for vLLM large scale deployment
      Rust
      •
      Apache License 2.0
      •135•377•23•44•Updated Aug 18, 2026Aug 18, 2026

    • vllm-neuron

      Public
      Community maintained hardware plugin for vLLM on AWS Neuron
      awsinferentiaaws-neuron
      awsinferentiaaws-neurontrainium
      Python
      •
      Apache License 2.0
      •32•48•2•8•Updated Aug 17, 2026Aug 17, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.