Skip to content

Conversation

@azaccor
Copy link

@azaccor azaccor commented Dec 23, 2025

Description: (required)

  • Add support for Databricks AI Gateway as a Portkey provider
  • Implements chat completions, text completions, and embeddings
  • Uses unified /invocations endpoint for all operations
  • Maintains OpenAI-compatible request/response format
  • Supports workspace-based and custom base URLs
  • Bearer token authentication with Databricks PATs

Tests Run/Test cases added: (required)

  • Tested with Llama 4 Maverick, Claude Sonnet 4.5, and GTE embedding models to ensure it worked across multiple functionalities, not just completion or chat, and also that the /invocations endpoint standard on Databricks model serving was able to successfully exception handle non OpenAI API style requests

Type of Change:

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation update
  • Refactoring (no functional changes)

- Add support for Databricks AI Gateway as a Portkey provider
- Implements chat completions, text completions, and embeddings
- Uses unified /invocations endpoint for all operations
- Maintains OpenAI-compatible request/response format
- Supports workspace-based and custom base URLs
- Bearer token authentication with Databricks PATs
- Tested with Meta Llama, Anthropic Claude, and embedding models
Copy link
Collaborator

@narengogi narengogi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@azaccor you've not registered the new provider in src/providers/index.ts so this code would clearly not work, please test your code thoroughly before raising a PR

@azaccor
Copy link
Author

azaccor commented Dec 28, 2025

@azaccor you've not registered the new provider in src/providers/index.ts so this code would clearly not work, please test your code thoroughly before raising a PR

Understood, thanks for the note. I will do that on Monday!

Copy link
Author

@azaccor azaccor left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding Databricks to src/providers/index.ts
Thank you for pointing that out!
Happy holidays

@azaccor azaccor requested a review from narengogi December 29, 2025 18:20
@azaccor azaccor removed their assignment Jan 5, 2026
@azaccor
Copy link
Author

azaccor commented Jan 7, 2026

Hi @narengogi , thanks again for your help! I've updated the index.ts file, so it should be ready for review now.
Cheers!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Provider] Databricks + Across hyperscalers like GCP, Azure, AWS

2 participants