feat: Add support for Azure AI Inference Service with DeepSeek-V3 model

[tmsjngx0]

Context

I'm adding support for Azure AI Inference Service with DeepSeek-V3 model integration. This enhancement allows users to utilize Azure AI's infrastructure to run the DeepSeek-V3 model, providing a more robust and scalable solution for AI inference. The implementation ensures proper handling of Azure-specific API paths, model parameters, and response formats.

Implementation

The implementation includes several key components:

1. Azure AI Inference Service Integration:

   • Added model parameter to Azure AI Inference Service client configuration
   • Implemented dedicated handler for Azure AI Inference Service models
   • Added proper path handling for Azure AI endpoints

2. DeepSeek-V3 Model Support:

   • Added support for DeepSeek-V3 model in Azure AI
   • Implemented proper message formatting for Azure AI
   • Added temperature settings specific to DeepSeek-V3

3. Testing Infrastructure:

   • Added comprehensive tests for Azure AI Inference Service
   • Implemented tests for both streaming and non-streaming responses
   • Added tests for completePrompt functionality

Key technical decisions:

• Used Azure AI's standard API paths for model inference
• Implemented proper error handling for Azure-specific responses
• Maintained backward compatibility with existing OpenAI integration

Screenshots

before	after
No Azure AI Inference Service support	Azure AI Inference Service with DeepSeek-V3 model support

How to Test

1. Set up Azure AI service:

   • Configure your Azure AI service URL
   • Set up your API key
   • Select DeepSeek-V3 model ID

2. Test Azure AI Integration:

   • Send a test prompt to verify Azure AI connection
   • Check both streaming and non-streaming responses
   • Verify model parameters are correctly passed

3. Verify Error Handling:

   • Test with invalid API key
   • Test with incorrect service URL
   • Verify proper error messages

4. Run Tests:

   npm test

   All Azure AI Inference Service tests should pass

Questions?

If you have any questions about the implementation or need clarification on any part of the changes, please feel free to ask in the PR comments.

---

Important

Add support for Azure AI Inference Service with DeepSeek-V3 model in OpenAiHandler, including Azure-specific path handling and comprehensive tests.

• Azure AI Inference Service Integration:
  • Added support for Azure AI Inference Service in OpenAiHandler in openai.ts.
  • Implemented Azure-specific path handling with AZURE_AI_INFERENCE_PATH.
  • Added isAzure flag to determine Azure usage.
• DeepSeek-V3 Model Support:
  • Integrated DeepSeek-V3 model with Azure AI in openai.ts.
  • Added temperature settings specific to DeepSeek-V3.
• Testing:
  • Added tests for Azure AI Inference Service in openai.test.ts.
  • Implemented tests for streaming and non-streaming responses.
  • Verified API calls with correct Azure paths in requesty.test.ts.

^{This description was created by for bc0f90c. It will automatically update as commits are pushed.}

[changeset-bot]

⚠️ No Changeset found

Latest commit: 9ff9b54

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

[mrubens]

Thank you for the contribution!