[Bots] Separating "Block AI bots" as a new page (cloudflare#23319)

* Separating "Block AI bots" as a new page

* Adding note to mention availability

* Wording edit

* Updating label to match UI

* Cross-referencing to AI Audit

---------

Co-authored-by: kodster28 <[email protected]>

Author: 2 people

src/content/docs/bots/additional-configurations/block-ai-bots.mdx

@@ -0,0 +1,31 @@
+---
+pcx_content_type: reference
+title: Block AI Bots
+sidebar:
+  order: 8
+  label: Block AI Bots
+---
+
+import { Render, Tabs, TabItem } from "~/components"
+
+:::note[Block AI bots availability]
+Note that **Block AI bots** feature is only available in the new application security dashboard (beta).
+
+To try the new dashboard, refer to [Application security dashboard (beta)](/security/).
+:::
+
+You can choose to block AI bots by activating **Block AI bots**. Activating this setting will block [verified bots](/bots/concepts/bot/verified-bots/overview/) that are classified in AI-related categories such as AI Assistant, AI Crawler, or an Archiver, as well as a number of unverified bots that behave similarly.
+
+To block [AI bots](/bots/concepts/bot/#ai-bots):
+
+1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/) and select your account and domain.
+2. Go to **Security** > **Settings**.
+3. Filter by **Bot traffic**.
+4. Go to **Block AI bots**.
+5. Under **Configurations**, select the edit icon. Choose from:
+   - **Only block on hostnames with ads**: Use this option if you wish to block AI bots only on portions of your site that show ads. Cloudflare automatically detects whether ads are present on a subdomain, and only block on hostnames that contain those ad units.
+   - **Block on all pages**: Use this option if you wish to block AI bots on all your pages.
+   - **Do not block (off)**: Use this option if you wish to allow AI bots on all your pages.
+6. Select **Save** to save your configuration.
+
+To block individual AI crawlers (rather than blocking all crawlers), use [AI Audit](/ai-audit/).

src/content/docs/bots/additional-configurations/managed-robots-txt.mdx

@@ -2,7 +2,7 @@
 pcx_content_type: reference
 title: Direct AI crawlers with managed robots.txt
 sidebar:
-  order: 8
+  order: 10
   label: Managed robots.txt
 ---
 

src/content/docs/bots/additional-configurations/static-resources.mdx

@@ -2,7 +2,7 @@
 pcx_content_type: reference
 title: Static resource protection
 sidebar:
-  order: 9
+  order: 12
 
 ---
 
@@ -12,7 +12,7 @@ Pro, Business, and Enterprise customers can use Cloudflare's bot solutions to pr
 
 :::caution[Warning]
 
-If you enable static resource protection, you may block good bots — like mail clients — that routinely fetch static resources. Make sure you understand your existing infrastructure before enabling this feature. 
+If you enable static resource protection, you may block good bots — like mail clients — that routinely fetch static resources. Make sure you understand your existing infrastructure before enabling this feature.
 :::
 
 ## Super Bot Fight Mode

src/content/docs/bots/get-started/bot-fight-mode.mdx

@@ -35,11 +35,11 @@ To disable Bot Fight Mode:
 
 ## Block AI bots
 
-<Render file="block-ai-bots-enable" params={{ one: "Bot Fight Mode" }} />
+Refer to [Block AI bots](/bots/additional-configurations/block-ai-bots/).
 
 :::note
 
-You can view blocked AI bot traffic via [Security Analytics](/waf/analytics/security-analytics/). 
+You can view blocked AI bot traffic via [Security Analytics](/waf/analytics/security-analytics/).
 :::
 
 ## Visibility

src/content/docs/bots/get-started/bot-management.mdx

@@ -44,7 +44,7 @@ Cloudflare recommends that you deploy the following basic settings and customize
 
 ### Block AI Bots
 
-<Render file="block-ai-bots-enable" params={{ one: "Bot Management" }} />
+Refer to [Block AI bots](/bots/additional-configurations/block-ai-bots/).
 
 :::note
 You can view blocked AI bot traffic via [Security Analytics](/waf/analytics/security-analytics/).

src/content/docs/bots/get-started/super-bot-fight-mode.mdx

@@ -42,11 +42,11 @@ Accounts with an Enterprise subscription but not the [Bot Management add-on](/bo
 
 ## Block AI bots
 
-<Render file="block-ai-bots-enable" params={{ one: "Super Bot Fight Mode" }} />
+Refer to [Block AI bots](/bots/additional-configurations/block-ai-bots/).
 
 :::note
 
-You can view blocked AI bot traffic via [Security Analytics](/waf/analytics/security-analytics/). 
+You can view blocked AI bot traffic via [Security Analytics](/waf/analytics/security-analytics/).
 :::
 
 ## Analytics