[Obs AI Assistant] Summarize function related test failures

[viduni94]

With the latest ES versions, the API test and a functional test related to the summarize function is failing.

In the API test, the error seen is:

Unhandled Promise rejection detected:

Error: Interceptor "Conversation: "Hello from LLM Proxy"" timed out after 30000ms
    at Timeout._onTimeout (create_llm_proxy.ts:319:33)
    at listOnTimeout (node:internal/timers:581:17)
    at processTimers (node:internal/timers:519:7)

Terminating process...
         │ info Killing running serverless ES nodes.

See related slack thread - https://elastic.slack.com/archives/C037J0RKRAN/p1744816323560039?thread_ts=1744811280.462969&cid=C037J0RKRAN

Failure when merging to main - #218327 (comment)
Failure when merging to 8.x - #218327 (comment)

In the functional test, the error seen is:
status: 500 org.elasticsearch.index.mapper.MapperException: timed out while waiting for a dynamic mapping update

info [r.suppressed] [ftr] path: /.kibana-observability-ai-assistant-kb/_doc/e0e6c856-a9de-4673-9c73-e2d4672d8805, params: {refresh=wait_for, index=.kibana-observability-ai-assistant-kb, id=e0e6c856-a9de-4673-9c73-e2d4672d8805}, status: 500 org.elasticsearch.index.mapper.MapperException: timed out while waiting for a dynamic mapping update
      	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.action.bulk.TransportShardBulkAction$1.onTimeout(TransportShardBulkAction.java:199)
      	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:390)
      	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:303)
      	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.cluster.service.ClusterApplierService$NotifyTimeout.run(ClusterApplierService.java:682)
      	at org.elasticsearch.server@9.1.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:977)
      	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1095)
      	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:619)
      	at java.base/java.lang.Thread.run(Thread.java:1447)
 proc [kibana] [2025-04-16T15:37:32.527-04:00][ERROR][plugins.observabilityAIAssistant.service.kb] Failed to add entry to knowledge base TimeoutError: Request timed out {"service":{"node":{"roles":["background_tasks","ui"]}}}

See related Slack thread - https://elastic.slack.com/archives/C05J7LXR5DE/p1744822078219769
Related issue - #218327

Haven't found the root cause yet. It could be a ES related issue as these tests or the function hasn't been changed recently.

[elasticmachine]

Pinging @elastic/obs-ai-assistant (Team:Obs AI Assistant)

[viduni94]

To reproduce run below commands:

API test:

node scripts/functional_tests --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.ai_assistant.serverless.config.ts --esServerlessImage=docker.elastic.co/elasticsearch-ci/elasticsearch-serverless:git-fe4087aa7b8c

Functional test:

ES_SNAPSHOT_MANIFEST="https://storage.googleapis.com/kibana-ci-es-snapshots-daily/9.1.0/archives/20250416-021648_85cb5f9a/manifest.json" node scripts/functional_tests_server --config x-pack/test/observability_ai_assistant_functional/enterprise/config.ts

[brianseeders]

This is the PR that caused this test to start failing: elastic/elasticsearch#126635

If you revert that commit on main and build an elasticserch-serverless snapshot, the test starts passing again.

If you believe there's a bug on the ES side related to this change (vs some change that the test or kibana needs to adapt to), you should work with the @elastic/es-search-relevance team to get the issue fixed or the change reverted.