Skip to content

add known issues for agent builder #3001

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Sep 18, 2025
Merged

add known issues for agent builder #3001

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
247ced1
Document some known issues
seanstory Sep 17, 2025
5d79668
Add jetbrains files to gitignore
seanstory Sep 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,10 @@
.artifacts
.DS_store

# Jetbrains files
.idea
*.iml

# Add LLM/AI related files
AGENTS.md
.github/copilot-instructions.md
Expand Down
23 changes: 21 additions & 2 deletions solutions/search/agent-builder/limitations-known-issues.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,12 +14,12 @@ Initally, {{agent-builder}} only supports working with the [Elastic Managed LLM]

Locally this picks the first AI connector available.

Initally, there are no UI controls to select which connector (and therefore which model) to use.
This can be changed under Stack Management -> AI -> GenAI Settings -> Default AI Connector.
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm optimistic that this will be in place by the time we ship. But we should follow this thread: https://elastic.slack.com/archives/C056H3WA1BL/p1757949389230719


## Known issues


- **Default agent misinterprets SQL syntax as ES|QL**
- **Default agent can misinterpret SQL syntax as ES|QL**
- The `.execute_esql` tool is designed only for [{{esql}}](elasticsearch://reference/query-languages/esql.md) syntax, not other query languages
- When using SQL syntax with the default agent, it attempts to use the `.execute_esql` tool instead of recognizing the input as SQL
- This results in parsing errors like this:
Expand All @@ -35,3 +35,22 @@ Initally, there are no UI controls to select which connector (and therefore whic
]
```

- **Not all LLMs are compatible**
- While Elastic offers LLM connectors for many different vendors and models, not all LLMs are robust enough to be used with {{agent-builder}}.
- Errors such as:
```console-response
Error: Invalid function call syntax
```
or
```
Error executing agent: No tool calls found in the response.
```
may indicate that your selected model is ill-equipped for the precise response structure necessary for {{agent-builder}}.
- We recommend using the [Elastic Managed LLM](kibana://reference/connectors-kibana/elastic-managed-llm.md)

- **{{agent-builder}} is not accessible**
- {{agent-builder}} was added in a private preview in September, 2025 for Serverless, and in 9.2.0 for Elastic Cloud.
- While in this preview stage, {{agent-builder}} is not enabled by default.
- To enable it, you must go to Stack Management -> Kibana -> Advanced Settings -> Elastic Agent Builder, and enable it.


Loading