Skip to content

Commit 9434d6f

Browse files
committed
Minor edits
1 parent 0037003 commit 9434d6f

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

src/content/docs/ai-crawl-control/features/manage-ai-crawlers.mdx

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -133,6 +133,8 @@ When blocking an AI crawler, you can configure the details of the response that
133133
- The response code
134134
- The response body
135135

136+
This provides you with a channel to open dialogue with the AI crawler owner, and to inform the AI crawler how to properly license their content, thereby creating a direct path from crawling attempt to commercial agreement.
137+
136138
To edit these values:
137139

138140
<Steps>
@@ -143,6 +145,10 @@ To edit these values:
143145
5. Once you have edited the values, select **Save**.
144146
</Steps>
145147

148+
:::note
149+
You must have opted to block at least one AI crawler to configure a custom block response.
150+
:::
151+
146152
### Edit the response code
147153

148154
You can choose which HTTP response code to return when blocking an AI crawler.
@@ -171,3 +177,4 @@ In the **Response body** text field, enter the response you wish to display for
171177
## Related resources
172178

173179
- Use [pay per crawl](/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/) to charge AI crawlers every time they access your content.
180+
- Blog: [TBC].

0 commit comments

Comments
 (0)