Skip to content

Commit e15c437

Browse files
Merge pull request #261796 from laujan/patch-2
Update data-filtering.md
2 parents d9bc309 + 06aa9c0 commit e15c437

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

articles/ai-services/translator/custom-translator/concepts/data-filtering.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ If you see a large discrepancy between the number of sentences in the source and
2424

2525
## Deduplication
2626

27-
Custom Translator removes the sentences that are present in test and tuning documents from training data. The removal happens dynamically inside of the training run, not in the data processing step. Custom Translator reports the sentence count to you in the project overview before such removal. **Deduplication doesn't apply if you choose to upload your own test and tuning documents**.
27+
Custom Translator removes the sentences that are present in test and tuning documents from training data. The removal happens dynamically inside of the training run, not in the data processing step. Custom Translator reports the sentence count to you in the project overview before such removal. Deduplication doesn't apply if you choose to upload your own test and tuning documents.
2828

2929
## Length filter
3030

0 commit comments

Comments
 (0)