Skip to content

Commit 2276053

Browse files
committed
[AI Audit] Rolling out DashButton for AI Crawl Control
1 parent 2d52536 commit 2276053

File tree

11 files changed

+77
-43
lines changed

11 files changed

+77
-43
lines changed

src/content/docs/ai-crawl-control/configuration/ai-crawl-control-with-waf.mdx

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ sidebar:
66

77
---
88

9-
import { GlossaryTooltip, Example, Steps, Tabs, TabItem } from "~/components";
9+
import { GlossaryTooltip, Example, Steps, Tabs, TabItem, DashButton } from "~/components";
1010

1111
AI Crawl Control works alongside other Cloudflare products, such as Cloudflare [Web Application Firewall (WAF)](/waf/). WAF checks incoming web and API requests, and filters undesired traffic based on rules. [WAF custom rules](/waf/custom-rules/) allow you to perform certain actions such as enforcing <GlossaryTooltip term="robots.txt">`robots.txt`</GlossaryTooltip>.
1212

@@ -85,8 +85,11 @@ In this scenario, you have two custom rules, each directing a different logic fo
8585
</TabItem> <TabItem label="New dashboard" icon="rocket">
8686

8787
<Steps>
88-
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/), and select your account and domain.
89-
2. Go to **Security** > **Security rules** and filter by **Custom rules**.
88+
1. In the Cloudflare dashboard, go to the **Security rules** page.
89+
90+
<DashButton url="/?to=/:account/:zone/security/security-rules" />
91+
92+
2. Filter by _Custom rules_.
9093
3. Identify your custom rule and the AI Crawl Control rule.
9194
4. Drag the rule you wish to prioritize to the top, or modify your custom rule to ensure it does not conflict with your AI Crawl Control configurations.
9295
</Steps>

src/content/docs/ai-crawl-control/features/analyze-ai-traffic.mdx

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ sidebar:
77
order: 2
88
---
99

10-
import { Steps, Tabs, TabItem } from "~/components";
10+
import { Steps, Tabs, TabItem, DashButton } from "~/components";
1111

1212
AI Crawl Control metrics provide you with insight on how AI crawlers are interacting with your website ([Cloudflare zone](/fundamentals/concepts/accounts-and-zones/#zones)).
1313

@@ -16,6 +16,8 @@ To view AI Crawl Control metrics:
1616
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/), and select your account and domain.
1717
2. Go to **AI Crawl Control**.
1818

19+
<DashButton url="/?to=/:account/:zone/ai" />
20+
1921
You can find meaningful information across both **Crawlers** and **Metrics** tabs.
2022

2123
## View AI crawler activity

src/content/docs/ai-crawl-control/features/manage-ai-crawlers.mdx

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,14 +5,17 @@ sidebar:
55
order: 5
66
---
77

8-
import { Steps, GlossaryTooltip, Tabs, TabItem, Example, Plan } from "~/components";
8+
import { Steps, GlossaryTooltip, Tabs, TabItem, Example, Plan, DashButton } from "~/components";
99

1010
AI Crawl Control enables you to take specific action for each AI crawler.
1111

1212
To manage AI crawlers:
1313

1414
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/), and select your account and domain.
1515
2. Go to **AI Crawl Control**.
16+
17+
<DashButton url="/?to=/:account/:zone/ai" />
18+
1619
3. Go to the **Crawlers** tab.
1720

1821
## Review AI crawler activity
@@ -137,6 +140,9 @@ To edit these values:
137140
<Steps>
138141
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/), and select your account and domain.
139142
2. Go to **AI Crawl Control**.
143+
144+
<DashButton url="/?to=/:account/:zone/ai" />
145+
140146
3. Go to the **Settings** tab.
141147
4. Under **Block response**, select **Edit**.
142148
5. Once you have edited the values, select **Save**.
@@ -169,8 +175,6 @@ You can write a custom message (HTTP response body) to return when blocking an A
169175

170176
In the **Response body** text field, enter the response you wish to display for the AI crawler in plain text.
171177

172-
{/* Need guidance on what sort of information they should include */}
173-
174178
## Related resources
175179

176180
- Use [pay per crawl](/ai-crawl-control/features/pay-per-crawl/what-is-pay-per-crawl/) to charge AI crawlers every time they access your content.

src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/connect-to-stripe.mdx

Lines changed: 9 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ sidebar:
77
order: 4
88
---
99

10-
import { Steps } from "~/components";
10+
import { Steps, DashButton } from "~/components";
1111

1212
```mermaid
1313
graph LR
@@ -21,12 +21,14 @@ Connect your Cloudflare account to Stripe to process payments. Pay per crawl use
2121

2222
{/* prettier-ignore */}
2323
<Steps>
24-
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/), and select your account.
25-
2. Go to **Manage Account** > **Configurations**.
26-
3. Go to the **Pay Per Crawl** tab.
27-
4. From **Connect to Stripe**, select **Connect**.
28-
5. Select **Continue to Stripe**.
29-
6. Follow the on-screen instructions to connect your Cloudflare account to a Stripe account.
24+
1. In the Cloudflare dashboard, go to **Manage Account** > **Settings**.
25+
26+
<DashButton url="/?to=/:account/configurations" />
27+
28+
2. Go to the **Pay Per Crawl** tab.
29+
3. From **Connect to Stripe**, select **Connect**.
30+
4. Select **Continue to Stripe**.
31+
5. Follow the on-screen instructions to connect your Cloudflare account to a Stripe account.
3032
:::note[Use a non-personal email address]
3133
Cloudflare recommends using a dedicated email to manage your pay per crawl account (for example, `[email protected]`).
3234
:::

src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-ai-owner/verify-ai-crawler.mdx

Lines changed: 8 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ sidebar:
55
order: 10
66
---
77

8-
import { Steps } from "~/components";
8+
import { Steps, DashButton } from "~/components";
99

1010
```mermaid
1111
graph LR
@@ -49,9 +49,11 @@ Submit a form to add your AI crawler to Cloudflare's list of verified bots.
4949

5050
{/* prettier-ignore */}
5151
<Steps>
52-
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/), and select your account.
53-
2. Go to **Manage Account** > **Configurations**.
54-
3. Go to the **Verified Bots** tab.
55-
4. Fill out the form.
56-
5. Select **Submit**.
52+
1. In the Cloudflare dashboard, go to **Manage Account** > **Settings**.
53+
54+
<DashButton url="/?to=/:account/configurations" />
55+
56+
2. Go to the **Bot Submission Form** tab.
57+
3. Fill out the form.
58+
4. Select **Submit**.
5759
</Steps>

src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/enable-in-account-settings.mdx

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ sidebar:
55
order: 2
66
---
77

8-
import { Steps } from "~/components";
8+
import { Steps, DashButton } from "~/components";
99

1010
```mermaid
1111
graph LR
@@ -35,8 +35,11 @@ An Administrator or Super Administrator with access to all domains must select w
3535

3636
{/* prettier-ignore */}
3737
<Steps>
38-
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/) and select your account.
39-
2. Go to **Manage Account** > **Settings** > **Pay Per Crawl**.
38+
1. In the Cloudflare dashboard, go to **Manage Account** > **Settings**.
39+
40+
<DashButton url="/?to=/:account/configurations" />
41+
42+
2. Select **Pay Per Crawl**.
4043
3. In the **Domain Access** table, select which domains will have pay per crawl configurations visible.
4144
4. Set the **Visibility** to **Visible** for each domain you want to configure.
4245
</Steps>

src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/manage-payouts.mdx

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ sidebar:
77
order: 6
88
---
99

10-
import { Steps } from "~/components";
10+
import { Steps, DashButton } from "~/components";
1111

1212
```mermaid
1313
graph LR
@@ -31,8 +31,11 @@ A person with **Administrator** or **Super Administrator** access must set up th
3131

3232
{/* prettier-ignore */}
3333
<Steps>
34-
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/) and select your account.
35-
2. Go to **Manage Account** > **Settings** > **Pay Per Crawl**.
34+
1. In the Cloudflare dashboard, go to **Manage Account** > **Settings**.
35+
36+
<DashButton url="/?to=/:account/configurations" />
37+
38+
2. Select **Pay Per Crawl**.
3639
3. In the **Stripe account** section, select **Connect**.
3740
4. Select **Continue to Stripe**.
3841
5. Complete Stripe's onboarding process, including:

src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/monitor-activity.mdx

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ sidebar:
55
order: 5
66
---
77

8-
import { Steps } from "~/components";
8+
import { Steps, DashButton } from "~/components";
99

1010
```mermaid
1111
graph LR
@@ -27,9 +27,11 @@ After configuring pay per crawl, monitor crawler activity to understand how AI c
2727

2828
{/* prettier-ignore */}
2929
<Steps>
30-
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/) and select your account and domain.
31-
2. Go to **AI Crawl Control**.
32-
3. Go to the **Metrics** tab to view detailed analytics.
30+
1. Go to **AI Crawl Control**.
31+
32+
<DashButton url="/?to=/:account/:zone/ai" />
33+
34+
2. Go to the **Metrics** tab to view detailed analytics.
3335
</Steps>
3436

3537
The metrics help you understand:

src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/select-crawlers-to-charge.mdx

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ sidebar:
55
order: 4
66
---
77

8-
import { Steps } from "~/components";
8+
import { Steps, DashButton } from "~/components";
99

1010
```mermaid
1111
graph LR
@@ -25,10 +25,12 @@ Once you have enabled pay per crawl and set a price, you can specify which AI cr
2525

2626
{/* prettier-ignore */}
2727
<Steps>
28-
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/) and select your account and domain.
29-
2. Go to **AI Crawl Control**.
30-
3. Go to the **Crawlers** tab.
31-
4. For each crawler, choose an action from the **Actions** column:
28+
1. Go to **AI Crawl Control**.
29+
30+
<DashButton url="/?to=/:account/:zone/ai" />
31+
32+
2. Go to the **Crawlers** tab.
33+
3. For each crawler, choose an action from the **Actions** column:
3234
- **Charge**: Charge the set price for successful content access
3335
- **Allow**: Allow free access without charging
3436
- **Block**: Block access completely

src/content/docs/ai-crawl-control/features/pay-per-crawl/use-pay-per-crawl-as-site-owner/set-a-pay-per-crawl-price.mdx

Lines changed: 9 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ sidebar:
55
order: 3
66
---
77

8-
import { Steps } from "~/components";
8+
import { Steps, DashButton } from "~/components";
99

1010
```mermaid
1111
graph LR
@@ -25,12 +25,14 @@ Once your domain's visibility is set to **Visible** in Account Settings, you can
2525

2626
{/* prettier-ignore */}
2727
<Steps>
28-
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/) and select your account and domain.
29-
2. Go to **AI Crawl Control**.
30-
3. Go to the **Settings** tab.
31-
4. In the **Pay Per Crawl** card, select **Enable**.
32-
5. Set your per crawl price - this is the amount charged for each successful content retrieval (HTTP 200 response) by an AI crawler.
33-
6. Select **Save**.
28+
1. Go to **AI Crawl Control**.
29+
30+
<DashButton url="/?to=/:account/:zone/ai" />
31+
32+
2. Go to the **Settings** tab.
33+
3. In the **Pay Per Crawl** card, select **Enable**.
34+
4. Set your per crawl price - this is the amount charged for each successful content retrieval (HTTP 200 response) by an AI crawler.
35+
5. Select **Save**.
3436
</Steps>
3537

3638
After enabling and setting a price, the domain's status in Account Settings will change to **Enabled**.

0 commit comments

Comments
 (0)