Skip to content

Validate Lite LLM Support #33

@matifali

Description

@matifali

Some Coder customers have already deployed LiteLLM internally and have also set it up to work with Coder. With Ai Bridge rolling out there can be two scenarios

  1. They replace LiteLLM with AI Bridge (which is ulikky at this stage as Coder Bridge is still minimal and not a full blown LLM gateway)
  2. They configure AiBridge to work along with existing LiteLLM.

This objective here is to validate 2.

https://www.litellm.ai/

Metadata

Metadata

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions