Repositories list

• llm-d

  Public

  llm-d/llm-d’s past year of commit activity
  Achieve state of the art inference performance with modern accelerators on Kubernetes

  Shell

  •

  Apache License 2.0

  •333•2.5k•104•102•Updated Mar 1, 2026Mar 1, 2026

• llm-d-inference-scheduler

  Public
  Inference scheduler for llm-d

  kubernetesainetworking+ 2inferencegateway-api

  Go

  •

  Apache License 2.0

  •133•136•60•15•Updated Mar 1, 2026Mar 1, 2026

• llm-d-inference-sim

  Public
  A light weight vLLM simulator, for mocking out replicas.

  incubating

  Go

  •

  Apache License 2.0

  •63•87•29•10•Updated Mar 1, 2026Mar 1, 2026

• llm-d-kv-cache

  Public

  llm-d/llm-d-kv-cache’s past year of commit activity
  Distributed KV cache scheduling & offloading libraries

  aiincubating

  Go

  •

  Apache License 2.0

  •94•108•51•29•Updated Mar 1, 2026Mar 1, 2026

• llm-d-benchmark

  Public
  llm-d benchmark scripts and tooling

  incubating

  Python

  •

  Apache License 2.0

  •52•48•74•8•Updated Feb 27, 2026Feb 27, 2026

• llm-d-workload-variant-autoscaler

  Public

  llm-d/llm-d-workload-variant-autoscaler’s past year of commit activity
  Variant optimization autoscaler for distributed inference workloads

  Go

  •

  Apache License 2.0

  •39•31•117•25•Updated Feb 27, 2026Feb 27, 2026

• llm-d-python-template

  Public template

  llm-d/llm-d-python-template’s past year of commit activity
  Python project template for llm-d repos. Use 'Use this template' to create a new Python project with standard CI, linting, Prow, and governance.

  Makefile

  •

  Apache License 2.0

  •0•0•1•3•Updated Feb 27, 2026Feb 27, 2026

• llm-d-go-template

  Public template

  llm-d/llm-d-go-template’s past year of commit activity
  Go microservice template for llm-d repos. Use 'Use this template' to create a new Go project with standard CI, linting, Prow, and governance.

  Makefile

  •

  Apache License 2.0

  •0•0•1•6•Updated Feb 27, 2026Feb 27, 2026

• llm-d.github.io

  Public
  Website for llm-d: This repository builds the website seen at llm-d.ai

  documentationopensourceai+ 1docusaurus

  JavaScript

  •24•11•9•5•Updated Feb 26, 2026Feb 26, 2026

• llm-d-infra

  Public
  repo for CI and infrastructure required to maintain llm-d org member repos

  Makefile

  •

  Apache License 2.0

  •2•0•13•3•Updated Feb 26, 2026Feb 26, 2026

• llm-d-pd-utils

  Public
  Makefile

  •5•5•7•6•Updated Feb 23, 2026Feb 23, 2026

• llm-d-prism

  Public
  0•0•1•0•Updated Feb 23, 2026Feb 23, 2026

• .github

  Public
  2•0•0•0•Updated Jan 8, 2026Jan 8, 2026

• llm-d-routing-sidecar

  Public archive
  Incubating P/D sidecar for llm-d

  incubating

  Go

  •

  Apache License 2.0

  •29•16•0•1•Updated Nov 13, 2025Nov 13, 2025

• llm-d-deployer

  Public archive
  Helm charts for llm-d

  helmhelm-chartllm-d

  Shell

  •

  Apache License 2.0

  •56•52•34•17•Updated Jul 22, 2025Jul 22, 2025

• llm-d-model-service

  Public archive
  Simplified model deployment on llm-d

  incubating

  Go

  •

  Apache License 2.0

  •15•28•29•6•Updated Jul 2, 2025Jul 2, 2025