From f35b71563d27e0b7cd9671ff14a30f2181d7b780 Mon Sep 17 00:00:00 2001 From: Patricia Loraine Santa Ana Date: Fri, 31 Jan 2025 09:07:05 -0800 Subject: [PATCH 1/2] clarify block ai bots behavior --- src/content/partials/bots/ai-bots-definition.mdx | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/src/content/partials/bots/ai-bots-definition.mdx b/src/content/partials/bots/ai-bots-definition.mdx index 47a4e0639701fb8..a4b294101a73f99 100644 --- a/src/content/partials/bots/ai-bots-definition.mdx +++ b/src/content/partials/bots/ai-bots-definition.mdx @@ -5,6 +5,10 @@ You can block artificial intelligence (AI) bots, crawlers, and scrapers from scraping your website content and training large language models (LLM) to recreate it without your permission. +When you enable this feature, all verified bots that are classified as AI Search, AI Assistant, AI Crawler, or an Archiver, as well as a number of unverified bots that fall into these [categories](/bots/reference/verified-bot-categories/) are blocked. It does not block verified bots that fall into the Search Engine categories. + +Refer to [Cloudflare Radar](https://radar.cloudflare.com/traffic/verified-bots) for examples of verified bots. + :::note Some AI bots overlap with definitely automated bots and verified bots, the latter becoming verified AI bots. From 3e17863b9da7c584c9c5a426707fede2d343b2ee Mon Sep 17 00:00:00 2001 From: Patricia Santa Ana <103445940+patriciasantaana@users.noreply.github.com> Date: Fri, 31 Jan 2025 09:14:44 -0800 Subject: [PATCH 2/2] Update src/content/partials/bots/ai-bots-definition.mdx Co-authored-by: marciocloudflare <83226960+marciocloudflare@users.noreply.github.com> --- src/content/partials/bots/ai-bots-definition.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/content/partials/bots/ai-bots-definition.mdx b/src/content/partials/bots/ai-bots-definition.mdx index a4b294101a73f99..cc5b0f7eca0184b 100644 --- a/src/content/partials/bots/ai-bots-definition.mdx +++ b/src/content/partials/bots/ai-bots-definition.mdx @@ -5,7 +5,7 @@ You can block artificial intelligence (AI) bots, crawlers, and scrapers from scraping your website content and training large language models (LLM) to recreate it without your permission. -When you enable this feature, all verified bots that are classified as AI Search, AI Assistant, AI Crawler, or an Archiver, as well as a number of unverified bots that fall into these [categories](/bots/reference/verified-bot-categories/) are blocked. It does not block verified bots that fall into the Search Engine categories. +When you enable this feature, all verified bots that are classified as AI Search, AI Assistant, AI Crawler, or an Archiver, as well as a number of unverified bots that fall into the [verified bot categories](/bots/reference/verified-bot-categories/) are blocked. It does not block verified bots that fall into the Search Engine categories. Refer to [Cloudflare Radar](https://radar.cloudflare.com/traffic/verified-bots) for examples of verified bots.