Skip to content

Commit 4e43233

Browse files
[Bots] Clarification wording to bots list (#22984)
* Adding clarification wording. * Update src/content/partials/bots/list-ai-bots.mdx Co-authored-by: windsurf-bot[bot] <189301087+windsurf-bot[bot]@users.noreply.github.com> * Adding wording about WAF * Adding note on bot fight mode. * Cross referencing to bots as well --------- Co-authored-by: windsurf-bot[bot] <189301087+windsurf-bot[bot]@users.noreply.github.com>
1 parent b324205 commit 4e43233

File tree

2 files changed

+13
-4
lines changed

2 files changed

+13
-4
lines changed

src/content/docs/ai-audit/get-started.mdx

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -13,10 +13,10 @@ description: Learn how to set up AI Audit.
1313

1414
import { Details, Render, Steps } from "~/components";
1515

16-
This guide instructs you through
16+
This guide instructs you on how to:
1717

18-
- Viewing AI crawlers that are interacting with your domain.
19-
- Creating a rule to block AI crawlers on your website.
18+
- View AI crawlers that are interacting with pages in your domain (a [Cloudflare zone](/fundamentals/concepts/accounts-and-zones/#zones)).
19+
- Create a rule to block AI crawlers on your pages.
2020

2121
## Prerequisites
2222

@@ -36,6 +36,11 @@ To use AI Audit:
3636
4. From the **Bot traffic** page, under **Block AI Bots**, select **Enable**.
3737
</Steps>
3838

39+
This feature also enables Cloudflare's [Bot Fight Mode: Block AI bots](/bots/get-started/bot-fight-mode/#block-ai-bots).
40+
41+
You can also create more complex rules when taking action on AI crawlers. For more information on creating more specific rules, refer to [Create a custom rule in the dashboard
42+
](/waf/custom-rules/create-dashboard/).
43+
3944
<Details header="Which bots will Cloudflare block?">
4045
<Render file="list-ai-bots" product="bots" />
4146
</Details>

src/content/partials/bots/list-ai-bots.mdx

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
{}
33
---
44

5-
When you enable this feature, Cloudflare will block the following bots:
5+
When you enable this feature, Cloudflare will block bots that have been identified as AI Crawlers. These bots include, but are not limited to, the following bots:
66

77
- `Amazonbot` (Amazon)
88
- `Applebot` (Apple)
@@ -24,8 +24,12 @@ When you enable this feature, Cloudflare will block the following bots:
2424

2525
In addition to this list, all verified bots that are classified as `AI Search`, `AI Assistant`, `AI Crawler`, or an `Archiver`, as well as a number of unverified bots that fall into the [verified bot categories](/bots/concepts/bot/verified-bots/categories/) are blocked. It does not block verified bots that fall into the `Search Engine` categories.
2626

27+
The bots classified in these categories may change in real time as new AI bots are detected.
28+
2729
:::note
2830
Some AI bots overlap with definitely automated bots and verified bots, the latter becoming verified AI bots.
2931

3032
For a partial list of verified AI Bots, refer to the [Cloudflare Radar](https://radar.cloudflare.com/bots#verified-bots) categories of AI Search, AI Assistant, or AI Crawler, as well as some other bots that harvest data for AI training.
3133
:::
34+
35+
If you are a bot operator and feel your bot may have been incorrectly categorized, [add your bot to the list of verified bots](https://dash.cloudflare.com/?to=/:account/configurations/verified-bots).

0 commit comments

Comments
 (0)