diff --git a/src/content/docs/ai-audit/get-started.mdx b/src/content/docs/ai-audit/get-started.mdx index f48e08e0768778c..06e8d8000707071 100644 --- a/src/content/docs/ai-audit/get-started.mdx +++ b/src/content/docs/ai-audit/get-started.mdx @@ -13,10 +13,10 @@ description: Learn how to set up AI Audit. import { Details, Render, Steps } from "~/components"; -This guide instructs you through +This guide instructs you on how to: -- Viewing AI crawlers that are interacting with your domain. -- Creating a rule to block AI crawlers on your website. +- View AI crawlers that are interacting with pages in your domain (a [Cloudflare zone](/fundamentals/concepts/accounts-and-zones/#zones)). +- Create a rule to block AI crawlers on your pages. ## Prerequisites @@ -36,6 +36,11 @@ To use AI Audit: 4. From the **Bot traffic** page, under **Block AI Bots**, select **Enable**. +This feature also enables Cloudflare's [Bot Fight Mode: Block AI bots](/bots/get-started/bot-fight-mode/#block-ai-bots). + +You can also create more complex rules when taking action on AI crawlers. For more information on creating more specific rules, refer to [Create a custom rule in the dashboard +](/waf/custom-rules/create-dashboard/). +
diff --git a/src/content/partials/bots/list-ai-bots.mdx b/src/content/partials/bots/list-ai-bots.mdx index 0c47687436decc9..52ae55a2b58c7a4 100644 --- a/src/content/partials/bots/list-ai-bots.mdx +++ b/src/content/partials/bots/list-ai-bots.mdx @@ -2,7 +2,7 @@ {} --- -When you enable this feature, Cloudflare will block the following bots: +When you enable this feature, Cloudflare will block bots that have been identified as AI Crawlers. These bots include, but are not limited to, the following bots: - `Amazonbot` (Amazon) - `Applebot` (Apple) @@ -24,8 +24,12 @@ When you enable this feature, Cloudflare will block the following bots: In addition to this list, all verified bots that are classified as `AI Search`, `AI Assistant`, `AI Crawler`, or an `Archiver`, as well as a number of unverified bots that fall into the [verified bot categories](/bots/concepts/bot/verified-bots/categories/) are blocked. It does not block verified bots that fall into the `Search Engine` categories. +The bots classified in these categories may change in real time as new AI bots are detected. + :::note Some AI bots overlap with definitely automated bots and verified bots, the latter becoming verified AI bots. For a partial list of verified AI Bots, refer to the [Cloudflare Radar](https://radar.cloudflare.com/bots#verified-bots) categories of AI Search, AI Assistant, or AI Crawler, as well as some other bots that harvest data for AI training. ::: + +If you are a bot operator and feel your bot may have been incorrectly categorized, [add your bot to the list of verified bots](https://dash.cloudflare.com/?to=/:account/configurations/verified-bots). \ No newline at end of file