Skip to content

Commit 12ce8a8

Browse files
neptunianmdbirnstiehl
authored andcommitted
Anonymization limitation update (elastic#3382)
Resolves elastic#3381 --------- Co-authored-by: Mike Birnstiehl <[email protected]>
1 parent 1f5f3d2 commit 12ce8a8

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

solutions/observability/observability-ai-assistant.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -524,6 +524,7 @@ Results for other languages or models may vary.
524524
### Limitations [obs-ai-anonymization-limitations]
525525
Anonymization has the following limitations:
526526

527+
* **Non-string fields**: {applies_to}`stack: ga 9.1.3` Anonymization only applies to string values. Booleans, numbers, image types, and other non-string values are ignored.
527528
* **Performance (NER)**: Running an NER model can add latency depending on the request. To improve performance of the model, consider scaling up your ML nodes by adjusting deployment parameters: increase `number_of_allocations` for better throughput and `threads_per_allocation` for faster individual requests. For details, refer to [start trained model deployment API](https://www.elastic.co/docs/api/doc/elasticsearch/operation/operation-ml-start-trained-model-deployment).
528529
* **Structured JSON**: The NER model we validated (`elastic/distilbert-base-uncased-finetuned-conll03-english`) is trained on natural English text and often misses entities inside JSON or other structured data. If thorough masking is required, prefer regex rules and craft them to account for JSON syntax.
529530
* **False negatives / positives**: No model or pattern is perfect. Model accuracy may vary depending on model and input.

0 commit comments

Comments
 (0)