Skip to content

@flashinfer-ai FlashInfer

Change the repository type filter

All

    Repositories list

    19 repositories

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      gpucudajit
      gpucudajitpytorchnvidiamoeattentionllm-inferencelarge-large-modelsdistributed-inference
      Python
      •
      Apache License 2.0
      •813•5.2k•349•175•Updated Mar 20, 2026Mar 20, 2026

    • whl

      Public
      Pre-built wheels for flashinfer python package.
      HTML
      •5•2•0•0•Updated Mar 20, 2026Mar 20, 2026

    • flashinfer-bench

      Public
      Building the Virtuous Cycle for AI-driven LLM Systems
      Python
      •
      Apache License 2.0
      •30•203•17•16•Updated Mar 19, 2026Mar 19, 2026

    • mlsys26-contest

      Public
      CSS
      •0•0•0•0•Updated Mar 17, 2026Mar 17, 2026

    • flashinfer-bench-starter-kit

      Public template
      FlashInfer Bench @ MLSys 2026: Building AI agents to write high performance GPU kernels
      Python
      •109•152•7•3•Updated Mar 13, 2026Mar 13, 2026

    • mlsys26-agent-baseline

      Public
      Python
      •
      Apache License 2.0
      •8•25•0•0•Updated Mar 12, 2026Mar 12, 2026

    • ci-infra

      Public
      Shell
      •
      Apache License 2.0
      •1•0•0•0•Updated Feb 20, 2026Feb 20, 2026

    • cubloaty

      Public
      a size profiler for cuda binary
      Python
      •
      Apache License 2.0
      •0•71•1•0•Updated Jan 15, 2026Jan 15, 2026

    • flashinfer-ai.github.io

      Public
      Project website of FlashInfer project
      SCSS
      •4•0•2•0•Updated Jan 3, 2026Jan 3, 2026

    • flashinfer-trace

      Public
      Python
      •4•3•0•2•Updated Oct 29, 2025Oct 29, 2025

    • web-data

      Public
      Apache License 2.0
      •0•0•0•0•Updated Jun 25, 2025Jun 25, 2025

    • cutlass-viz

      Public
      Python
      •
      Apache License 2.0
      •3•65•0•0•Updated Apr 26, 2025Apr 26, 2025

    • tg4perfetto

      Public
      Simple python library for generating your own perfetto traces for your application. Can be used for both app instrumentation and custom trace generation (for y…
      Python
      •
      Apache License 2.0
      •8•1•0•0•Updated Apr 16, 2025Apr 16, 2025

    • flashinfer-nightly

      Public archive
      FlashInfer Nightly
      MIT License
      •1•6•0•0•Updated Apr 9, 2025Apr 9, 2025

    • performance-tracking

      Public
      Apache License 2.0
      •0•4•0•0•Updated Apr 2, 2025Apr 2, 2025

    • llm-based-compression

      Public
      Jupyter Notebook
      •0•2•0•0•Updated Jan 10, 2025Jan 10, 2025

    • debug-print

      Public
      Debug print operator for cudagraph debugging
      Cuda
      •2•14•1•1•Updated Aug 2, 2024Aug 2, 2024

    • llvm-project

      Public
      The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.
      Other
      •17k•0•0•0•Updated Apr 21, 2024Apr 21, 2024

    • candle

      Public
      Minimalist ML framework for Rust
      Rust
      •
      Apache License 2.0
      •1.5k•0•0•0•Updated Mar 7, 2024Mar 7, 2024