[Bots] Update AI bots info (#22961)

* [Bots] Update AI bots info

* one more perplexity

* update to include ai audit

Author: kodster28

src/content/docs/ai-audit/get-started.mdx

@@ -11,7 +11,7 @@ head:
 description: Learn how to set up AI Audit.
 ---
 
-import { Render, Steps } from "~/components";
+import { Details, Render, Steps } from "~/components";
 
 This guide instructs you through
 
@@ -36,6 +36,16 @@ To use AI Audit:
 4. From the **Bot traffic** page, under **Block AI Bots**, select **Enable**.
 </Steps>
 
+<Details header="Which bots will Cloudflare block?">
+	<Render file="list-ai-bots" product="bots" />
+</Details>
+
+:::note
+
+For more details on how this rule interacts with other Cloudflare settings, refer to [How it works](/bots/concepts/bot/#how-it-works).
+
+:::
+
 ## 2. Block specific bot categories (Enterprise plan only)
 
 Customers on the Enterprise plan -- and with a [Bot Management subscription](/bots/plans/bm-subscription/) -- can choose to only block specific AI crawlers, while allowing others.

src/content/docs/bots/concepts/bot/index.mdx

@@ -6,18 +6,17 @@ sidebar:
 learning_center:
   title: What is a bot?
   link: https://www.cloudflare.com/learning/bots/what-is-a-bot/
-  
 ---
 
-import { Render } from "~/components"
+import { Render } from "~/components";
 
 <Render file="what-is-a-bot" />
 
 Bots can be used for good (chatbots, search engine crawlers) or for evil (inventory hoarding, credential stuffing).
 
 :::note[More information]
 
-For more background, refer to [What is a bot?](https://www.cloudflare.com/learning/bots/what-is-a-bot/). 
+For more background, refer to [What is a bot?](https://www.cloudflare.com/learning/bots/what-is-a-bot/).
 :::
 
 ## Verified bots
@@ -26,14 +25,42 @@ For more background, refer to [What is a bot?](https://www.cloudflare.com/learni
 
 :::note
 
-The method for allowing or blocking verified bots depends on [your plan](/bots/get-started/). 
+The method for allowing or blocking verified bots depends on [your plan](/bots/get-started/).
 :::
 
 ## AI bots
 
-<Render file="ai-bots-definition" />
+You can block artificial intelligence (AI) bots, crawlers, and scrapers from scraping your website content and training large language models (LLM) to recreate it without your permission.
+
+### Which bots are blocked
+
+<Render file="list-ai-bots" />
+
+### How it works
+
+When you enable this feature via a pre-configured managed rule, Cloudflare can detect and block verified AI bots that comply with `robots.txt` and respect crawl rates, and do not hide their behavior from your website. The rule has also been expanded to include more signatures of AI bots that do not follow the rules.
+
+The rule to block AI bots takes precedence over all other Super Bot Fight Mode rules. For example, if you have enabled **Block AI bots** and **Allow verified bots**, verified AI bots will also be blocked even if you allow other verified bots on your website or application.
+
+For Bot Management customers, if you have set a rule to serve managed challenges to definitely automated bots, AI bots will also be challenged because custom rules run in a phase before Super Bot Fight Mode, which is the phase when the rule to block AI bots runs.
+
+This behavior remains the same if the setting for verified, definitely automated, and likely bots is set to `block` or `allow`. If you have an action to `allow` for these rules, the request is not matched to any rule and proceeds to the next ruleset phase. Similarly, if the action is set to `block`, they will be blocked in the earlier phase and do not move on to match the AI rule at all. However, when the action is `challenge`, the request matches a rule and therefore will not be matched to any rules after.
+
+For self-serve non-Bot Management customers, all rules for verified, definitely automated, and likely bots run in the phase following the AI bots rule.
+
+```mermaid
+---
+title: Rule phases
+---
+flowchart LR
+accTitle: AI bots rule phases diagram
+accDescr: This diagram details the phases in which AI bots rules run.
+A[Custom rules] --> B[Block AI bots<br>managed rule] --> C[Allow verified bots rule]
+```
+
+This feature is available on all Cloudflare plans.
 
 :::note
 
-The method for blocking AI bots depends on [your plan](/bots/get-started/). 
+The method for blocking AI bots depends on [your plan](/bots/get-started/).
 :::

src/content/partials/bots/ai-bots-definition.mdx

@@ -0,0 +1,31 @@
+---
+{}
+---
+
+When you enable this feature, Cloudflare will block the following bots:
+
+- `Amazonbot` (Amazon)
+- `Applebot` (Apple)
+- `Bytespider` (ByteDance)
+- `ChatGPT-User` (OpenAI)
+- `ClaudeBot` (Anthropic)
+- `Claude-SearchBot` (Anthropic)
+- `Claude-User` (Anthropic)
+- `DuckAssistBot` (DuckDuckGo)
+- `Google-CloudVertexBot` (Google)
+- `GoogleOther` (Google)
+- `GPTBot` (OpenAI)
+- `Meta-ExternalAgent` (Meta)
+- `OAI-SearchBot` (OpenAI)
+- `PerplexityBot` (Perplexity)
+- `Perplexity-User` (Perplexity)
+- `PetalBot` (Huawei)
+- `TikTokSpider` (ByteDance)
+
+In addition to this list, all verified bots that are classified as `AI Search`, `AI Assistant`, `AI Crawler`, or an `Archiver`, as well as a number of unverified bots that fall into the [verified bot categories](/bots/concepts/bot/verified-bots/categories/) are blocked. It does not block verified bots that fall into the `Search Engine` categories.
+
+:::note
+Some AI bots overlap with definitely automated bots and verified bots, the latter becoming verified AI bots.
+
+For a partial list of verified AI Bots, refer to the [Cloudflare Radar](https://radar.cloudflare.com/bots#verified-bots) categories of AI Search, AI Assistant, or AI Crawler, as well as some other bots that harvest data for AI training.
+:::