Skip to content

Commit 18d7a1d

Browse files
committed
AI bots -> crawler audit
1 parent 281b4ff commit 18d7a1d

File tree

3 files changed

+5
-5
lines changed

3 files changed

+5
-5
lines changed

src/content/docs/ai-audit/features/analyze-ai-crawlers.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,7 @@ AI Audit provides you with the following metrics to help you understand how AI c
3030
| Most popular paths by AI crawlers | The most popular pages crawled by AI crawlers, for each AI crawler |
3131
| Hosts | Top five most requested hosts (website domains) |
3232
| Paths | Top five most requested paths |
33-
| Bot Operators | Top five most active bot operators (by requests) |
33+
| Bot Operators | Top five most active AI crawler operators (by requests) |
3434

3535
## Filter the date range
3636

src/content/docs/ai-audit/features/manage-ai-crawlers.mdx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -50,9 +50,9 @@ You can block an AI crawler to completely stop the AI crawler from scraping your
5050

5151
You can use filters to narrow the scope of your result.
5252

53-
- **Name:** Filter by the bot name by searching the name of the bot.
53+
- **Name:** Search the name of the AI crawler.
5454
- **Operator:** Filter by the AI crawler operator.
55-
- **Category:** Filter by the category of the AI bot (for example, AI crawler, AI assistant, or archiver).
55+
- **Category:** Filter by the category of the AI crawler (for example, AI crawler, AI assistant, or archiver).
5656
- **Date range:** Filter the date range of your results. You can choose from three predetermined date ranges:
5757
- Past 7 days
5858
- Past 14 days

src/content/docs/ai-audit/get-started.mdx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ To block all AI crawlers:
3838
4. From **Block AI Bots**, toggle the switch.
3939
</Steps>
4040

41-
This blocks all AI crawlers requesting access to your domain. You will also see all of the individual switches for bots automatically toggle to **Block**.
41+
This blocks all AI crawlers requesting access to your domain. You will also see all of the individual switches for AI crawlers automatically toggle to **Block**.
4242

4343
Note that blocking all AI crawlers using this method also enables Cloudflare's [Bot Fight Mode: Block AI bots](/bots/get-started/bot-fight-mode/#block-ai-bots).
4444

@@ -84,7 +84,7 @@ To only block specific AI crawlers:
8484
3. Review key information such as:
8585
- Bot operator
8686
- Number of requests sent by the AI crawler
87-
- Whether the bot is allowed according to your `robots.txt`, or the number of times the AI crawler has violated your `robots.txt`.
87+
- Whether the AI crawler is allowed according to your `robots.txt`, or the number of times the AI crawler has violated your `robots.txt`.
8888
4. From the **Block** column, toggle the switch for AI crawlers you with to block.
8989
</Steps>
9090

0 commit comments

Comments
 (0)