Skip to content
This repository was archived by the owner on Jul 22, 2025. It is now read-only.

Commit df63e36

Browse files
authored
FEATURE: Make Mixtral tokenizer available for embeddings (#1258)
1 parent 0024f2d commit df63e36

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

app/models/embedding_definition.rb

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -23,6 +23,7 @@ def tokenizer_names
2323
DiscourseAi::Tokenizer::GeminiTokenizer,
2424
DiscourseAi::Tokenizer::MultilingualE5LargeTokenizer,
2525
DiscourseAi::Tokenizer::OpenAiTokenizer,
26+
DiscourseAi::Tokenizer::MixtralTokenizer,
2627
].map(&:name)
2728
end
2829

0 commit comments

Comments
 (0)