Skip to content

Commit 9a7e484

Browse files
Merge pull request #261739 from laujan/patch-1
Update data-filtering.md
2 parents 79452c4 + 533800a commit 9a7e484

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

articles/ai-services/translator/custom-translator/concepts/data-filtering.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ description: When you submit documents to be used for training a custom system,
55
author: laujan
66
manager: nitinme
77
ms.service: azure-ai-translator
8-
ms.date: 07/18/2023
8+
ms.date: 12/21/2023
99
ms.author: lajanuar
1010
ms.topic: conceptual
1111
ms.custom: cogserv-non-critical-translator
@@ -24,7 +24,7 @@ If you see a large discrepancy between the number of sentences in the source and
2424

2525
## Deduplication
2626

27-
Custom Translator removes the sentences that are present in test and tuning documents from training data. The removal happens dynamically inside of the training run, not in the data processing step. Custom Translator reports the sentence count to you in the project overview before such removal.
27+
Custom Translator removes the sentences that are present in test and tuning documents from training data. The removal happens dynamically inside of the training run, not in the data processing step. Custom Translator reports the sentence count to you in the project overview before such removal. **Deduplication doesn't apply if you choose to upload your own test and tuning documents**.
2828

2929
## Length filter
3030

0 commit comments

Comments
 (0)