Repositories list

• gpustack

  Public
  Performance-optimized AI inference on your GPUs. Unlock superior throughput by selecting and tuning engines like vLLM or SGLang.

  cudainferenceopenai+ 15

  cudainferenceopenaillamamaasrocmascendllmllm-servingvllm+ 8

  Python

  •

  Apache License 2.0

  •463•4.6k•452•32•Updated Mar 6, 2026Mar 6, 2026

• benchmark-runner

  Public

  gpustack/benchmark-runner’s past year of commit activity
  Python

  •

  Apache License 2.0

  •1•1•1•0•Updated Mar 6, 2026Mar 6, 2026

• gpustack-ui

  Public
  TypeScript

  •

  Apache License 2.0

  •55•74•2•5•Updated Mar 5, 2026Mar 5, 2026

• runner

  Public
  Collection of Dockerfiles to build images for various inference services across different accelerated backends.

  Dockerfile

  •

  Apache License 2.0

  •8•9•0•0•Updated Mar 4, 2026Mar 4, 2026

• runtime

  Public

  gpustack/runtime’s past year of commit activity
  Provides a unified interface to detect GPU resources and manages GPU workloads.

  Python

  •

  Apache License 2.0

  •10•11•0•1•Updated Mar 2, 2026Mar 2, 2026

• gpustack-higress-plugin

  Public
  Go

  •2•1•0•0•Updated Feb 28, 2026Feb 28, 2026

• community-inference-backends

  Public
  Community Inference Backends for GPUStack V2

  Python

  •

  Apache License 2.0

  •7•7•0•1•Updated Feb 13, 2026Feb 13, 2026

• gguf-parser-go

  Public

  gpustack/gguf-parser-go’s past year of commit activity
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

  gollama-cppgguf+ 2

  gollama-cppggufstable-diffusion-cppllama-box

  Go

  •

  MIT License

  •24•247•0•0•Updated Feb 11, 2026Feb 11, 2026

• .github

  Public

  gpustack/.github’s past year of commit activity
  Meta-Github repository for all GPUStack repositories.

  github-metadata

  github-metadata

  Apache License 2.0

  •4•1•0•0•Updated Feb 4, 2026Feb 4, 2026

• gpustack.github.io

  Public

  gpustack/gpustack.github.io’s past year of commit activity
  HTML

  •2•1•0•0•Updated Jan 6, 2026Jan 6, 2026

• vox-box

  Public
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

  pythontext-to-speechtts+ 5

  pythontext-to-speechttsspeech-to-textsttaudio-processingasropenai-compatible-api

  Python

  •

  Apache License 2.0

  •32•198•15•1•Updated Dec 23, 2025Dec 23, 2025

• llama-box

  Public archive

  gpustack/llama-box’s past year of commit activity
  LM inference server implementation based on *.cpp.

  cpptransformerdiffusion+ 2

  cpptransformerdiffusionggufopenai-compatible-api

  C++

  •

  MIT License

  •28•296•2•0•Updated Nov 24, 2025Nov 24, 2025

• gpustack-helper

  Public
  Python

  •

  Apache License 2.0

  •2•1•1•0•Updated Aug 26, 2025Aug 26, 2025

• fastfetch

  Public
  Like neofetch, but much faster because written mostly in C.

  C

  •

  MIT License

  •706•2•0•0•Updated Oct 24, 2024Oct 24, 2024

• gguf-packer-go

  Public
  Deliver LLMs of GGUF format via Dockerfile.

  gollamagguf

  gollamagguf

  Go

  •

  MIT License

  •4•15•0•0•Updated Oct 24, 2024Oct 24, 2024