Skip to content

Commit 95d5ae8

Browse files
OxyjunOxyjun
committed
Setting up more pages for AI Audit docs
1 parent bf572b5 commit 95d5ae8

File tree

8 files changed

+91
-17
lines changed

8 files changed

+91
-17
lines changed

‎src/content/docs/ai-audit/features/ai-crawler-detection.mdx‎

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
---
2+
title: AI crawler detection
3+
pcx_content_type: concept
4+
sidebar:
5+
order: 2
6+
---
7+
8+
TBC

‎src/content/docs/ai-audit/features/index.mdx‎

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
---
2+
title: Features
3+
pcx_content_type: navigation
4+
sidebar:
5+
group:
6+
hideIndex: true
7+
order: 5
8+
---
9+
10+
import { DirectoryListing } from "~/components";
11+
12+
<DirectoryListing />

‎src/content/docs/ai-audit/get-started.mdx‎

Lines changed: 22 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -14,22 +14,35 @@ description: Learn how to set up AI Audit.
1414

1515
import { Render } from "~/components";
1616

17-
## Activate AI Audit
17+
## Prerequisites
18+
19+
1. Sign up for a [Cloudflare account](https://dash.cloudflare.com/sign-up/).
20+
2. [Connect your domain to Cloudflare](/fundamentals/manage-domains/add-site/).
21+
22+
## 1. Block all AI crawlers
1823

1924
To enable AI Audit:
2025

2126
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/), and select your account and domain.
2227
2. Go to **AI Audit**.
28+
3. From **AI Crawlers** tab, toggle **Block AI Crawlers**.
29+
4. From the **Bot traffic** page, under **Block AI Bots**, select **Enable**.
2330

24-
If you do not have access to AI Audit in the Cloudflare dashboard, check if your user has one of the [necessary roles](/page-shield/reference/roles-and-permissions/).
25-
26-
## Review detected AI crawlers
27-
28-
When you enable AI Audit, it may take a while to get the list of detected scripts in your domain.
29-
30-
Review the scripts displayed in the [**Monitors** dashboard](/page-shield/detection/monitor-connections-scripts/), checking them for signs of malicious activity.
31+
:::note[Enterprise customers]
32+
Customers on the Enterprise plan can choose to block only specific AI crawlers, while allowing others.
3133

32-
Depending on your plan, you may be able to also review the connections made by scripts in your domain's pages and check them for malicious activity.
34+
In the **AI Crawlers** tab, block individual AI crawlers by toggling the switch under the **Block** column.
35+
:::
3336

37+
## 2. Review detected AI crawlers
3438

39+
Review the AI crawlers detected on your site in the **Metrics** tab of the Cloudflare dashboard for key metrics. You can specify a time period, and view:
3540

41+
- Number of total AI crawler requests
42+
- Number of blocked requests
43+
- Number of allowed requests
44+
- Number of review requests by each AI crawler
45+
- Most popular paths of your website by each AI crawler
46+
- Hosts (AI crawler owners)
47+
- Overall most popular paths in your website accessed by AI crawlers
48+
- Most active AI crawlers

‎src/content/docs/ai-audit/index.mdx‎

Lines changed: 4 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -28,14 +28,10 @@ Learn how to [get started](/ai-audit/get-started/).
2828
## Features
2929

3030
<Feature
31-
header="Monitors"
32-
href="/page-shield/detection/monitor-connections-scripts/"
33-
cta="Monitor resources"
31+
header="AI crawler detection"
32+
href="/ai-audit/features/ai-crawler-detection/"
33+
cta="View AI crawlers"
3434
>
35-
Displays information about loaded scripts in your domain's pages and the
36-
connections they make.
35+
Displays information about AI crawlers in your domains' pages.
3736
</Feature>
3837

39-
## Availability
40-
41-
<FeatureTable id="security.page_shield" />

‎src/content/docs/ai-audit/reference/allowed-ai-crawlers.mdx‎

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
---
2+
title: List of allowed AI crawlers
3+
pcx_content_type: concept
4+
sidebar:
5+
order: 2
6+
---
7+
8+
TBC

‎src/content/docs/ai-audit/reference/index.mdx‎

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,12 @@
1+
---
2+
title: Reference
3+
pcx_content_type: navigation
4+
sidebar:
5+
group:
6+
hideIndex: true
7+
order: 10
8+
---
9+
10+
import { DirectoryListing } from "~/components";
11+
12+
<DirectoryListing />

‎src/content/docs/ai-audit/release-notes.mdx‎

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
---
2+
pcx_content_type: changelog
3+
title: Release notes
4+
release_notes_file_name:
5+
- d1
6+
sidebar:
7+
order: 100
8+
---
9+
10+
import { ProductReleaseNotes } from "~/components";
11+
12+
{/* <!-- Actual content lives in /src/content/release-notes/ai-audit.yaml. Update the file there for new entries to appear here. For more details, refer to https://developers.cloudflare.com/style-guide/documentation-content-strategy/content-types/changelog/#yaml-file --> */}
13+
14+
<ProductReleaseNotes />

‎src/content/release-notes/ai-audit.yaml‎

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
---
2+
link: "/ai-audit/changelog/"
3+
productName: AI Audit
4+
productLink: "/ai-audit/"
5+
productArea: Core platform
6+
productAreaLink: /core/reference/changelog/security/
7+
entries:
8+
- publish_date: "2025-06-09"
9+
title: Documentation for AI Audit
10+
description: There is now documentation for AI Audit
11+

0 commit comments

Comments
 (0)