Skip to content

Commit d753886

Browse files
authored
[8.19] docs: add 429 semantic_text troubleshooting (#132747)
1 parent 40758e7 commit d753886

File tree

1 file changed

+21
-2
lines changed

1 file changed

+21
-2
lines changed

docs/reference/troubleshooting/common-issues/rejected-requests.asciidoc

Lines changed: 21 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -63,7 +63,7 @@ rejections, use the <<cluster-nodes-stats,node stats API>>.
6363
GET _nodes/stats?human&filter_path=nodes.*.indexing_pressure
6464
----
6565

66-
These stats are cumulative from node startup.
66+
These stats are cumulative from node startup.
6767

6868
Indexing pressure rejections appear as an
6969
`EsRejectedExecutionException`, and indicate that they were rejected due
@@ -73,12 +73,31 @@ These errors are often related to <<task-queue-backlog,backlogged tasks>>,
7373
<<docs-bulk,bulk index>> sizing, or the ingest target's
7474
<<index-modules,`refresh_interval` setting>>.
7575

76+
NOTE: Another cause of indexing pressure rejections might be the use of the <<semantic-text,`semantic_text`>> field type, which can cause rejections when indexing large batches of documents if the batch may otherwise incur an Out of Memory (OOM) error.
77+
7678
[discrete]
7779
[[prevent-rejected-requests]]
7880
==== Prevent rejected requests
7981

80-
**Fix high CPU and memory usage**
82+
[discrete]
83+
[[fix-high-cpu-and-memory-usage]]
84+
===== Fix high CPU and memory usage
8185

8286
If {es} regularly rejects requests and other tasks, your cluster likely has high
8387
CPU usage or high JVM memory pressure. For tips, see <<high-cpu-usage>> and
8488
<<high-jvm-memory-pressure>>.
89+
90+
[discrete]
91+
[[fix-semantic-text-ingestion-issues]]
92+
===== Fix for `semantic_text` ingestion issues
93+
94+
When bulk indexing documents with the `semantic_text` field type, you may encounter rejections due to high memory usage during inference processing.
95+
These rejections will appear as an `InferenceException` in your cluster logs.
96+
97+
**To resolve this issue:**
98+
99+
1. Reduce the batch size of documents in your indexing requests.
100+
2. If reducing batch size doesn't resolve the issue, then consider scaling up your machine resources.
101+
3. A last resort option is to adjust the `indexing_pressure.memory.coordinating.limit` cluster setting. The default value is 10% of the heap. Increasing this limit allows more memory to be used for coordinating operations before rejections occur.
102+
103+
WARNING: This adjustment should only be considered after exhausting other options, as setting this value too high may risk Out of Memory (OOM) errors in your cluster. A cluster restart is required for this change to take effect.

0 commit comments

Comments
 (0)