Skip to content

Commit bd6e0ab

Browse files
Create 2025-08-27-402-payment-required.mdx
1 parent 8cec7c9 commit bd6e0ab

File tree

1 file changed

+37
-0
lines changed

1 file changed

+37
-0
lines changed
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
---
2+
title: AI Crawl Control
3+
description: Configure 402 responses for blocked AI crawlers
4+
date: 2025-08-27T11:00:00Z
5+
---
6+
7+
You can now return HTTP 402 "Payment Required" responses when blocking AI crawlers, enabling direct communication with crawler operators about licensing terms.
8+
When blocking AI crawlers, you can configure:
9+
- **Response code:** Choose between 403 Forbidden or 402 Payment Required
10+
- **Response body:** Add a custom message with your licensing contact information
11+
12+
13+
Example 402 response:
14+
15+
<TypeScriptExample>
16+
17+
```ts title="worker.ts"
18+
HTTP 402 Payment Required
19+
Date: Mon, 24 Aug 2025 12:56:49 GMT
20+
Content-type: application/json
21+
Server: cloudflare
22+
Cf-Ray: 967e8da599d0c3fa-EWR
23+
Cf-Team: 2902f6db750000c3fa1e2ef400000001
24+
{
25+
"message": "To access this content, email [email protected] or call 1-800-LICENSE.
26+
}
27+
```
28+
</TypeScriptExample>
29+
30+
**How it works:**
31+
32+
- **For all users:**
33+
- If you're not using the ["Block AI bots"](https://developers.cloudflare.com/bots/get-started/bot-fight-mode/#block-ai-bots) setting, nothing changes today. Blocked crawlers from the AI Audit dashboard will continue to see 403 forbidden responses by default.
34+
- If you have the ["Block AI bots"](https://developers.cloudflare.com/bots/get-started/bot-fight-mode/#block-ai-bots) set to block on all pages, AI training crawlers will now automatically see 402 Payment Required status code.
35+
- **For paid users:** Block individual crawlers and customize your 402 message from AI Crawl Control > Settings > Block response
36+
37+
This provides a way to communicate information to crawlers instead of just blocking them.

0 commit comments

Comments
 (0)