Skip to content

Enhance Mistral Conversation Api Component to make the endpoint configurable #4056

@fabistb

Description

@fabistb

Describe the feature

3rd party services like Azure AI Foundry allow to use Mistral models but have a custom endpoint.
With the current setup it isn't possible to use a custom endpoint and utilize these 3rd party services.

Metadata

apiVersion: dapr.io/v1alpha1
kind: Component
metadata:
  name: mistral
spec:
  type: conversation.mistral
  metadata:
  - name: key
    value: mykey
  - name: model
    value: open-mistral-7b
  - name: cacheTTL
    value: 10m
  - name: endpoint
    value: 'https://example.com'

Release Note

RELEASE NOTE: ADD Mistral endpoint configurability

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions