-
Notifications
You must be signed in to change notification settings - Fork 42
Open
Labels
Milestone
Description
Is your feature request related to a problem? Please describe.
Data Designer currently supports models provided with an OAI or Azure OAI compliant endpoint only.
Describe the solution you'd like
Data Designer should have better support for different types of endpoints, like VertexAI or Bedrock endpoints which do not follow the OAI spec.
Describe alternatives you've considered
For e.g. when using Gemini models on Vertex AI, you could use the OAI compliant endpoint, but if I have an VertexAI API key that has generous rate limits, I can't use that with the OAI compliant endpoint.
Additional context
Data Designer should have native support for the following provider types: Vertex AI, Bedrock, SageMaker, Databricks, DataRobot, and Groq.