Skip to content

[ML] Exposing ai21 and llama in the services api #133233

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Aug 27, 2025
Merged

[ML] Exposing ai21 and llama in the services api #133233

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
dff32c5
Exposing ai21 and llama in the services api
jonathan-buttner Aug 20, 2025
829d4bf
Merge branch 'main' of github.com:elastic/elasticsearch into ml-expos…
jonathan-buttner Aug 22, 2025
492bd57
Fixing tests
jonathan-buttner Aug 22, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 7 additions & 0 deletions ...tests/src/javaRestTest/java/org/elasticsearch/xpack/inference/InferenceGetServicesIT.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,7 @@ public void testGetServicesWithoutTaskType() throws IOException {
allProviders(),
containsInAnyOrder(
List.of(
"ai21",
"alibabacloud-ai-search",
"amazonbedrock",
"anthropic",
Expand All @@ -47,6 +48,7 @@ public void testGetServicesWithoutTaskType() throws IOException {
"googlevertexai",
"hugging_face",
"jinaai",
"llama",
"mistral",
"openai",
"streaming_completion_test_service",
Expand Down Expand Up @@ -91,6 +93,7 @@ public void testGetServicesWithTextEmbeddingTaskType() throws IOException {
"googlevertexai",
"hugging_face",
"jinaai",
"llama",
"mistral",
"openai",
"text_embedding_test_service",
Expand Down Expand Up @@ -131,6 +134,8 @@ public void testGetServicesWithCompletionTaskType() throws IOException {
providersFor(TaskType.COMPLETION),
containsInAnyOrder(
List.of(
"ai21",
"llama",
"alibabacloud-ai-search",
"amazonbedrock",
"anthropic",
Expand All @@ -157,6 +162,8 @@ public void testGetServicesWithChatCompletionTaskType() throws IOException {
providersFor(TaskType.CHAT_COMPLETION),
containsInAnyOrder(
List.of(
"ai21",
"llama",
"deepseek",
"elastic",
"openai",
Expand Down
6 changes: 0 additions & 6 deletions .../inference/src/main/java/org/elasticsearch/xpack/inference/services/ai21/Ai21Service.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -227,12 +227,6 @@ public TransportVersion getMinimalSupportedVersion() {
return TransportVersions.ML_INFERENCE_AI21_COMPLETION_ADDED;
}

@Override
public boolean hideFromConfigurationApi() {
// The AI21 service is very configurable so we're going to hide it from being exposed in the service API.
return true;
}

@Override
public Set<TaskType> supportedStreamingTasks() {
return EnumSet.of(TaskType.COMPLETION, TaskType.CHAT_COMPLETION);
Expand Down
6 changes: 0 additions & 6 deletions ...nference/src/main/java/org/elasticsearch/xpack/inference/services/llama/LlamaService.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -366,12 +366,6 @@ public TransportVersion getMinimalSupportedVersion() {
return TransportVersions.ML_INFERENCE_LLAMA_ADDED;
}

@Override
public boolean hideFromConfigurationApi() {
// The Llama service is very configurable so we're going to hide it from being exposed in the service API.
return true;
}

/**
* Configuration class for the Llama inference service.
* It provides the settings and configurations required for the service.
Expand Down