Skip to content

DevOps: Local LLM deployment #35

@Siddharth-Khattar

Description

@Siddharth-Khattar

DoD:

  • The API keys from the AET Open WebUI platform are used to utilise a local model.
  • UI is updated to allow the user to select between the local and the cloud based OpenAI model
  • GenAI backend is appropriately adjusted with UI model selection being done through a middleman API

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions