Skip to content

Commit 0037003

Browse files
committed
Editing note about WAF setting
1 parent 3adbd4f commit 0037003

File tree

1 file changed

+10
-8
lines changed

1 file changed

+10
-8
lines changed

src/content/docs/ai-crawl-control/features/manage-ai-crawlers.mdx

Lines changed: 10 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -149,8 +149,16 @@ You can choose which HTTP response code to return when blocking an AI crawler.
149149

150150
Use the dropdown menu to select the desired response code. You can choose from:
151151

152-
- **403 Forbidden**: Use this option if you wish to indicate that you do not want the AI crawler to access your content.
153-
- **402 Payment Required:** Use this option if you wish to indicate that the AI crawler must pay to access your content.
152+
- `403 Forbidden`: Use this option if you wish to indicate that you do not want the AI crawler to access your content.
153+
- `402 Payment Required`: Use this option if you wish to indicate that the AI crawler must pay to access your content.
154+
155+
:::note
156+
Behind the scenes, AI Crawl Control uses [Cloudflare WAF](/waf/) to return custom block responses.
157+
158+
If you have manually configured a WAF rule to return a response code other than `403` or `402`, AI Crawl Control will not be able to enforce the response code you have selected, and the dropdown will appear blank. Ensure you have selected either `403` or `402`.
159+
160+
Refer to [Configure a custom response for blocked requests](/waf/custom-rules/create-dashboard/#configure-a-custom-response-for-blocked-requests) for more information.
161+
:::
154162

155163
### Edit the response body
156164

@@ -160,12 +168,6 @@ In the **Response body** text field, enter the response you wish to display for
160168

161169
{/* Need guidance on what sort of information they should include */}
162170

163-
:::note
164-
Behind the scenes, AI Crawl Control uses WAF to return custom block responses.
165-
166-
Refer to [Configure a custom response for blocked requests](/waf/custom-rules/create-dashboard/#configure-a-custom-response-for-blocked-requests).
167-
:::
168-
169171
## Related resources
170172

171173
- Use [pay per crawl](/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/) to charge AI crawlers every time they access your content.

0 commit comments

Comments
 (0)