Skip to content

@basetenlabs Baseten

Change the repository type filter

All

    Repositories list

    65 repositories

    • truss

      Public
      The simplest way to serve AI/ML models in production
      open-sourcemachine-learningpackagingartificial-intelligencefalconeasy-to-usewhisperinference-servermodel-servinginference-api
      Python
      •
      MIT License
      •87•1.1k•64•31•Updated Sep 19, 2025Sep 19, 2025

    • ml-cookbook

      Public
      Ready-to-use ML training recipes to help you build and deploy models on Baseten.
      MIT License
      •0•28•0•5•Updated Sep 18, 2025Sep 18, 2025

    • genai-bench

      Public
      Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
      Python
      •
      MIT License
      •20•0•0•0•Updated Sep 17, 2025Sep 17, 2025

    • gorilla

      Public
      Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
      Python
      •
      Apache License 2.0
      •1.2k•0•0•3•Updated Sep 15, 2025Sep 15, 2025

    • truss-examples

      Public
      Examples of models deployable with Truss
      pythondockermachine-learningaiexamplesmlops
      Python
      •
      MIT License
      •49•203•14•57•Updated Sep 12, 2025Sep 12, 2025

    • action-slack

      Public
      Provides the function of slack notification to GitHub Actions.
      TypeScript
      •
      MIT License
      •142•0•0•2•Updated Sep 12, 2025Sep 12, 2025

    • harmony

      Public
      Renderer for the harmony response format to be used with gpt-oss
      Rust
      •
      Apache License 2.0
      •203•0•0•1•Updated Aug 30, 2025Aug 30, 2025

    • async-openai

      Public
      Rust library for OpenAI
      Rust
      •
      MIT License
      •312•0•0•0•Updated Aug 20, 2025Aug 20, 2025

    • LatentSync

      Public
      Taming Stable Diffusion for Lip Sync!
      Python
      •
      Apache License 2.0
      •795•0•0•2•Updated Aug 6, 2025Aug 6, 2025

    • TensorRT-Model-Optimizer

      Public
      A unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.
      Python
      •
      Other
      •160•1•0•3•Updated Aug 6, 2025Aug 6, 2025

    • create-pull-request

      Public
      A GitHub action to create a pull request for changes to your repository in the actions workspace
      TypeScript
      •
      MIT License
      •500•0•0•2•Updated Jul 22, 2025Jul 22, 2025

    • lws

      Public
      LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
      Go
      •
      Apache License 2.0
      •109•0•0•2•Updated Jul 18, 2025Jul 18, 2025

    • llm-tools

      Public
      Python
      •
      MIT License
      •0•0•0•1•Updated Jul 15, 2025Jul 15, 2025

    • action-junit-report

      Public
      Reports junit test results as GitHub Pull Request Check
      TypeScript
      •
      Apache License 2.0
      •148•0•0•3•Updated Jul 12, 2025Jul 12, 2025

    • truss-grpc-example

      Public
      Go
      •0•0•0•1•Updated Jul 7, 2025Jul 7, 2025

    • frontend-take-home

      Public
      Front-End Take Home Challenge
      TypeScript
      •12•2•0•1•Updated Jun 30, 2025Jun 30, 2025

    • agent-workshop

      Public
      Build agents powered by open models
      Jupyter Notebook
      •
      MIT License
      •1•3•0•0•Updated Jun 12, 2025Jun 12, 2025

    • SGLang-Workshop

      Public
      Workshop materials for AI Engineer World's Fair
      Jupyter Notebook
      •
      MIT License
      •11•10•0•0•Updated Jun 3, 2025Jun 3, 2025

    • nx-set-shas

      Public
      ✨ A Github Action which sets the base and head SHAs required for `nx affected` commands in CI
      TypeScript
      •
      MIT License
      •86•0•0•1•Updated May 15, 2025May 15, 2025

    • changed-files

      Public
      :octocat: Github action to retrieve all (added, copied, modified, deleted, renamed, type changed, unmerged, unknown) files and directories.
      TypeScript
      •
      MIT License
      •306•0•0•1•Updated May 15, 2025May 15, 2025

    • frontend-log-viewer-challenge

      Public
      TypeScript
      •0•1•0•1•Updated May 15, 2025May 15, 2025

    • inference-optimization-interview

      Public
      1•1•0•0•Updated Mar 24, 2025Mar 24, 2025

    • honeymarker

      Public
      Add Honeycomb Markers to your GitHub Actions workflows.
      Dockerfile
      •
      Other
      •6•0•0•0•Updated Mar 17, 2025Mar 17, 2025

    • setup-mpi

      Public
      Set up your GitHub Actions workflow to use MPI
      Shell
      •
      MIT License
      •5•0•0•0•Updated Mar 17, 2025Mar 17, 2025

    • flashinfer

      Public
      FlashInfer: Kernel Library for LLM Serving
      Cuda
      •
      Apache License 2.0
      •507•0•0•0•Updated Feb 6, 2025Feb 6, 2025

    • .github

      Public
      0•0•0•0•Updated Jan 13, 2025Jan 13, 2025

    • autoscaler

      Public
      Autoscaling components for Kubernetes
      Go
      •
      Apache License 2.0
      •4.2k•0•0•3•Updated Dec 11, 2024Dec 11, 2024

    • axolotl

      Public
      Go ahead and axolotl questions
      Python
      •
      Apache License 2.0
      •1.1k•0•0•2•Updated Nov 7, 2024Nov 7, 2024

    • HackMIT-2024

      Public
      Jupyter Notebook
      •1•2•0•0•Updated Sep 14, 2024Sep 14, 2024

    • Workshop-TRT-LLM

      Public
      Python
      •12•19•0•0•Updated Jun 26, 2024Jun 26, 2024