Skip to content

Commit 6ccfffc

Browse files
authored
Removed duplicate text from configuration parameters
1 parent 797677f commit 6ccfffc

File tree

1 file changed

+3
-9
lines changed

1 file changed

+3
-9
lines changed

specs/crawler/common/schemas/configuration.yml

Lines changed: 3 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -39,19 +39,15 @@ Configuration:
3939
items:
4040
type: string
4141
description: |
42-
URLs to exclude from crawling.
43-
44-
Uses [micromatch](https://github.com/micromatch/micromatch) for negation, wildcards, and more.
42+
Use [micromatch](https://github.com/micromatch/micromatch) for negation, wildcards, and more.
4543
externalData:
4644
type: array
4745
description: |
4846
References to external data sources for enriching the extracted records.
49-
50-
For more information, see [Enrich extracted records with external data](https://www.algolia.com/doc/tools/crawler/guides/enriching-extraction-with-external-data/).
5147
maxItems: 10
5248
items:
5349
type: string
54-
description: Reference to an external data source you configured in the Crawler dashboard.
50+
description: For more information, see [Enrich extracted records with external data](https://www.algolia.com/doc/tools/crawler/guides/enriching-extraction-with-external-data/).
5551
example: testCSV
5652
extraUrls:
5753
type: array
@@ -94,15 +90,13 @@ Configuration:
9490
9591
All URLs with the matching query parameters are treated as identical.
9692
This prevents indexing URLs that just differ by their query parameters.
97-
98-
Use wildcards to match multiple query parameters.
9993
maxItems: 9999
10094
example:
10195
- ref
10296
- utm_*
10397
items:
10498
type: string
105-
description: Query parameter to ignore. You can include wildcards to match a range of similar query parameters.
99+
description: Use wildcards to match multiple query parameters.
106100
ignoreRobotsTxtRules:
107101
type: boolean
108102
description: Whether to ignore rules defined in your `robots.txt` file.

0 commit comments

Comments
 (0)