You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Remediates documents that have been stored in a data stream's failure store by restoring them to their original format. This processor is designed to work with documents that failed during ingestion and were automatically stored in the failure store with additional error metadata and document structure wrapping.
9
+
Recovers documents that have been stored in a data stream's failure store by restoring them to their original format. This processor is designed to work with documents that failed during ingestion and were automatically stored in the failure store with additional error metadata and document structure wrapping. The relevant failure store metadata is stashed under _ingest.pre_recovery.
10
10
11
11
The Recover Failure Document processor performs the following operations:
12
12
13
-
* Extracts the original document source from the `document.source` field
13
+
* Checks the document is a valid failure store document.
14
+
* Stores the pre-recovery metadata of the document (all document fields except for `document.source`) under the ingest metadata _ingest.pre_recovery.
15
+
* Overwrites `_source` with the original document source from the `document.source` field
16
+
* Restores the original document id from `document._id` to the document metadata
14
17
* Restores the original index name from `document.index` to the document metadata
15
18
* Restores the original routing value from `document.routing` to the document metadata (if present)
16
19
* Removes the failure-related fields (`error` and `document`) from the document
@@ -82,7 +85,27 @@ Which produces the following response:
"stack_trace": "j.l.IllegalArgumentException: field [counter] not present as part of path [counter] at o.e.i.IngestDocument.getFieldValue(IngestDocument.java: 202 at o.e.i.c.SetProcessor.execute(SetProcessor.java: 86) 14 more",
103
+
"type": "illegal_argument_exception",
104
+
"message": "field [counter] not present as part of path [counter]"
0 commit comments