cloudflare · Oxyjun · Aug 27, 2025 · Aug 18, 2025 · Aug 18, 2025 · Aug 18, 2025
@@ -95,7 +95,7 @@
 /src/content/docs/d1/ @elithrar @rozenmd @vy-ton @joshthoward @oxyjun @harshil1712 @cloudflare/pcx-technical-writing
 /src/content/release-notes/d1.yaml @elithrar @rozenmd @vy-ton @joshthoward @oxyjun @cloudflare/pcx-technical-writing
 /src/content/partials/d1/ @elithrar @rozenmd @vy-ton @joshthoward @oxyjun @harshil1712 @cloudflare/pcx-technical-writing
-/src/content/docs/ai-audit/ @oxyjun @kodster28 @cloudflare/pcx-technical-writing
+/src/content/docs/ai-crawl-control/ @oxyjun @kodster28 @cloudflare/pcx-technical-writing
 /src/content/docs/durable-objects/ @elithrar @vy-ton @joshthoward @oxyjun @harshil1712 @mikenomitch @cloudflare/pcx-technical-writing @cloudflare/workers-runtime-1
 /src/content/release-notes/durable-objects.yaml @elithrar @rozenmd @vy-ton @joshthoward @oxyjun @cloudflare/pcx-technical-writing
 /src/content/docs/email-routing/ @cloudflare/pcx-technical-writing

@@ -149,9 +149,9 @@
 /ai/ /use-cases/ai/ 301
 
 # ai-audit
-/ai-audit/features/detect-ai-crawlers/ /ai-audit/features/analyze-ai-crawlers/ 301
-/ai-audit/features/enforce-robots-txt/ /ai-audit/features/analyze-ai-crawlers/ 301
-/ai-audit/features/analyze-ai-crawlers/ /ai-audit/features/analyze-ai-traffic/ 301
+/ai-audit/features/detect-ai-crawlers/ /ai-crawl-control/features/analyze-ai-crawlers/ 301
+/ai-audit/features/enforce-robots-txt/ /ai-crawl-control/features/analyze-ai-crawlers/ 301
+/ai-audit/features/analyze-ai-crawlers/ /ai-crawl-control/features/analyze-ai-traffic/ 301
 
 # AI Gateway
 /ai-gateway/get-started/configuring-settings/ /ai-gateway/get-started/ 301
@@ -2270,6 +2270,9 @@
 /logs/get-started/enable-destinations/* /logs/logpush/logpush-job/enable-destinations/:splat 301
 /logs/reference/log-fields/* /logs/logpush/logpush-job/datasets/:splat 301
 
+# AI Crawl Control
+/ai-audit/* /ai-crawl-control/:splat 301
+
 # Cloudflare One / Zero Trust
 /cloudflare-one/connections/connect-networks/install-and-setup/tunnel-guide/local/as-a-service/* /cloudflare-one/connections/connect-networks/configure-tunnels/local-management/as-a-service/:splat 301
 /cloudflare-one/connections/connect-apps/install-and-setup/deployment-guides/* /cloudflare-one/connections/connect-networks/deployment-guides/:splat 301

@@ -1,17 +1,17 @@
 ---
-title: AI Audit
+title: AI Crawl Control
 description: AI Audit is available to all customers
 date: 2024-09-23
 ---
 
-Every site on Cloudflare now has access to [**AI Audit**](/ai-audit/), which summarizes the crawling behavior of popular and known AI services.
+Every site on Cloudflare now has access to [**AI Audit**](/ai-crawl-control/), which summarizes the crawling behavior of popular and known AI services.
 
 You can use this data to:
 
 - Understand how and how often crawlers access your site (and which content is the most popular).
 - Block specific AI bots accessing your site.
 - Use Cloudflare to enforce your `robots.txt` policy via an automatic WAF rule.
 
-![View AI bot activity with AI Audit](~/assets/images/changelog/ai-audit/ai-audit-overview.png)
+![View AI bot activity with AI Audit](~/assets/images/changelog/ai-crawl-control/ai-crawl-control-overview.png)
 
-To get started, explore [AI audit](/ai-audit/).
+To get started, explore [AI audit](/ai-crawl-control/).
@@ -0,0 +1,22 @@
+---
+title: Introducing Pay Per Crawl (private beta)
+description: A new feature which allows site owners to charge crawlers for access to their content
+date: 2025-07-01
+---
+
+We are introducing a new feature of [AI Crawl Control](/ai-crawl-control/) — Pay Per Crawl. [Pay Per Crawl](/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/) enables site owners to require payment from AI crawlers every time the crawlers access their content, thereby fostering a fairer Internet by enabling site owners to control and monetize how their content gets used by AI.
+
+![Pay per crawl](~/assets/images/changelog/ai-crawl-control/pay-per-crawl.png)
+
+**For Site Owners:**
+
+- Set pricing and select which crawlers to charge for content access
+- Manage payments via Stripe
+- Monitor analytics on successful content deliveries
+
+**For AI Crawler Owners:**
+
+- Use HTTP headers to request and accept pricing
+- Receive clear confirmations on charges for accessed content
+
+Learn more in the [Pay Per Crawl documentation](/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/).
@@ -0,0 +1,19 @@
+---
+title: AI Crawl Control refresh
+description: More intuitive AI crawler management
+date: 2025-07-01
+---
+
+We redesigned the AI Crawl Control dashboard to provide more intuitive and granular control over AI crawlers.
+
+- From the new **AI Crawlers** tab: block specific AI crawlers.
+- From the new **Metrics** tab: view AI Crawl Control metrics.
+
+![Block AI crawlers](~/assets/images/changelog/ai-crawl-control/manage-ai-crawlers.png)
+
+![Analyze AI crawler activity](~/assets/images/changelog/ai-crawl-control/analyze-metrics.png)
+
+To get started, explore:
+
+- [Manage AI crawlers](/ai-crawl-control/features/manage-ai-crawlers/).
+- [Analyze AI traffic](/ai-crawl-control/features/analyze-ai-traffic/).
@@ -0,0 +1,39 @@
+---
+title: Enhanced crawler insights and custom 402 responses
+description: Get detailed crawler analytics with trend charts and configure custom payment-required responses for blocked AI crawlers.
+date: 2025-08-27
+---
+
+We improved AI crawler management with detailed analytics and introduced custom HTTP 402 responses for blocked crawlers. AI Audit has been renamed to AI Crawl Control and is now generally available.
+
+**Enhanced Crawlers tab:**
+
+- View total allowed and blocked requests for each AI crawler
+- Trend charts show crawler activity over your selected time range per crawler
+
+![Updated AI Crawl Control table showing request counts and trend charts](~/assets/images/changelog/ai-crawl-control/ai-crawl-control-table.png)
+
+**Custom block responses (paid plans):**
+You can now return HTTP 402 "Payment Required" responses when blocking AI crawlers, enabling direct communication with crawler operators about licensing terms.
+
+For users on paid plans, when blocking AI crawlers you can configure:
+
+- **Response code:** Choose between 403 Forbidden or 402 Payment Required
+- **Response body:** Add a custom message with your licensing contact information
+
+![AI Crawl Control block response configuration interface](~/assets/images/changelog/ai-crawl-control/ai-crawl-control-block-response.png)
+
+Example 402 response:
+
+```http
+HTTP 402 Payment Required
+Date: Mon, 24 Aug 2025 12:56:49 GMT
+Content-type: application/json
+Server: cloudflare
+Cf-Ray: 967e8da599d0c3fa-EWR
+Cf-Team: 2902f6db750000c3fa1e2ef400000001
+
+{
+  "message": "Please contact the site owner for access."
+}
+```