Skip to content

Commit f35b715

Browse files
clarify block ai bots behavior
1 parent f94766b commit f35b715

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

src/content/partials/bots/ai-bots-definition.mdx

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,10 @@
55

66
You can block artificial intelligence (AI) bots, crawlers, and scrapers from scraping your website content and training large language models (LLM) to recreate it without your permission.
77

8+
When you enable this feature, all verified bots that are classified as AI Search, AI Assistant, AI Crawler, or an Archiver, as well as a number of unverified bots that fall into these [categories](/bots/reference/verified-bot-categories/) are blocked. It does not block verified bots that fall into the Search Engine categories.
9+
10+
Refer to [Cloudflare Radar](https://radar.cloudflare.com/traffic/verified-bots) for examples of verified bots.
11+
812
:::note
913
Some AI bots overlap with definitely automated bots and verified bots, the latter becoming verified AI bots.
1014

0 commit comments

Comments
 (0)