basic

Basic Deployment Example

This example demonstrates the simplest deployment of the Inference Gateway using Helm.

Table of Contents

• Basic Deployment Example
  • Table of Contents
  • Architecture
  • Prerequisites
  • Quick Start
  • Configuration
    • Gateway Settings
  • Cleanup

Architecture

• Gateway: Inference Gateway deployed via helm chart
• Ingress: Basic ingress configuration

Prerequisites

• Task
• kubectl
• helm
• ctlptl (for cluster management)

Quick Start

1. Deploy infrastructure:

task deploy-infrastructure

2. Deploy Inference Gateway:

task deploy-inference-gateway

3. Test the gateway:

curl http://api.inference-gateway.local/v1/models

Configuration

Gateway Settings

• Configured via helm values in Taskfile.yaml
• No additional components required

Cleanup

task clean