fix: add codestral-embed model support for OpenAI-compatible provider #6142
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
This PR fixes issue #6141 where the
codestral-embedmodel fails with 3072 dimensions when used via the OpenAI-compatible provider.Problem
When users configure the OpenAI-compatible provider to use the
codestral-embedmodel with 3072 dimensions, the system was unable to find the dimension configuration and would fall back to default behavior, causing a dimension mismatch error in Qdrant.Solution
Added the
codestral-embedmodel configuration to theopenai-compatibleprovider section inembeddingModels.tswith the correct 3072 dimension support.Changes
codestral-embedmodel to theopenai-compatibleprovider with dimension: 3072 and scoreThreshold: 0.4embeddingModels.spec.tsto ensure the model configuration works correctlyTesting
Fixes #6141
Important
Fixes issue #6141 by adding
codestral-embedmodel support with 3072 dimensions to the OpenAI-compatible provider and adds tests for verification.codestral-embedmodel toopenai-compatibleprovider inembeddingModels.tswith 3072 dimensions.scoreThresholdto 0.4 forcodestral-embed.embeddingModels.spec.tsto verifycodestral-embedconfiguration foropenai-compatibleandmistralproviders.getModelDimension()for correct dimension retrieval.This description was created by
for 34e67cf. You can customize this summary. It will automatically update as commits are pushed.