Skip to content

Commit cacb286

Browse files
committed
Documenting AI Audit metrics
1 parent 95d5ae8 commit cacb286

File tree

5 files changed

+44
-20
lines changed

5 files changed

+44
-20
lines changed

src/content/docs/ai-audit/features/ai-crawler-detection.mdx

Lines changed: 22 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,4 +5,25 @@ sidebar:
55
order: 2
66
---
77

8-
TBC
8+
AI Audit metrics provides you with insight on how AI crawlers are interacting with your website.
9+
10+
## View AI Audit metrics
11+
12+
AI Audit provides you with the following metrics to help you understand how AI crawlers are interacting with your website.
13+
14+
| Metric | Description |
15+
| ------------------------------------- | ----------------------------------------------------------------------------- |
16+
| Total AI crawler requests | The total number of requests to crawl your website, from all AI crawlers |
17+
| Blocked requests | The number of requests you have blocked (by blocking AI crawlers) |
18+
| Allowed requests | The number of requests you have allowed (by allowing AI crawlers) |
19+
| Request by AI crawlers | A graph which displays the number of crawl requests from each AI crawler |
20+
| Most popular paths by AI crawlers | The most popular pages crawled by AI crawlers, for each AI crawler |
21+
| Hosts | The owner of the AI crawler |
22+
| Overall popular paths | The most popular pages crawled by AI crawlers, from all AI crawlers |
23+
| Most active AI crawlers by bot owners | The AI crawler owners with the highest number of requests to access your site |
24+
25+
## Filter date range
26+
27+
You can use the date filter to choose the period of time you wish to analyze.
28+
29+
Click on the date filter dropdown and select the range of dates. The values of the AI Audit metrics will update according to your filter.

src/content/docs/ai-audit/get-started.mdx

Lines changed: 13 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ description: Learn how to set up AI Audit.
1212

1313
---
1414

15-
import { Render } from "~/components";
15+
import { Render, Steps } from "~/components";
1616

1717
## Prerequisites
1818

@@ -23,26 +23,24 @@ import { Render } from "~/components";
2323

2424
To enable AI Audit:
2525

26+
<Steps>
2627
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/), and select your account and domain.
2728
2. Go to **AI Audit**.
2829
3. From **AI Crawlers** tab, toggle **Block AI Crawlers**.
2930
4. From the **Bot traffic** page, under **Block AI Bots**, select **Enable**.
31+
</Steps>
3032

31-
:::note[Enterprise customers]
32-
Customers on the Enterprise plan can choose to block only specific AI crawlers, while allowing others.
33+
## 2. Block specific AI crawlers (Enterprise plan only)
3334

34-
In the **AI Crawlers** tab, block individual AI crawlers by toggling the switch under the **Block** column.
35-
:::
35+
Customers on the Enterprise plan can choose to only block specific AI crawlers, while allowing others.
3636

37-
## 2. Review detected AI crawlers
37+
<Steps>
38+
1. Go to the **AI Crawlers** tab.
39+
2. Toggle the switch under the **Block** column for the AI crawlers you wish to block.
40+
</Steps>
3841

39-
Review the AI crawlers detected on your site in the **Metrics** tab of the Cloudflare dashboard for key metrics. You can specify a time period, and view:
42+
## 3. Review detected AI crawlers
4043

41-
- Number of total AI crawler requests
42-
- Number of blocked requests
43-
- Number of allowed requests
44-
- Number of review requests by each AI crawler
45-
- Most popular paths of your website by each AI crawler
46-
- Hosts (AI crawler owners)
47-
- Overall most popular paths in your website accessed by AI crawlers
48-
- Most active AI crawlers
44+
Review the AI crawlers detected on your site in the **Metrics** tab of the Cloudflare dashboard for key metrics.
45+
46+
Refer to [AI crawler detection](/ai-audit/ai-crawler-detection/) for more information.

src/content/docs/ai-audit/index.mdx

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -3,13 +3,14 @@ title: AI Audit
33
pcx_content_type: overview
44
sidebar:
55
order: 1
6+
badge: Beta
67
head:
78
- tag: title
89
content: Overview
910
description: AI Audit is a tool which allows you to analyze and control how third-party AI crawlers interact with your website.
1011
---
1112

12-
import { Description, Feature, FeatureTable, Plan } from "~/components";
13+
import { Description, Feature, FeatureTable, Plan, LinkButton } from "~/components";
1314

1415
<Description>
1516

@@ -21,7 +22,11 @@ Analyze and control third-party AI crawlers in your website.
2122

2223
AI Audit helps manage AI crawlers on your website by providing visibility on which crawlers are accessing your webpage, and allowing you to block unwanted crawlers.
2324

24-
Learn how to [get started](/ai-audit/get-started/).
25+
<LinkButton href="/ai-audit/get-started/">Get started </LinkButton>
26+
27+
:::note[Beta phase]
28+
AI Audit is currently only available as a beta product.
29+
:::
2530

2631
---
2732

src/content/docs/ai-audit/release-notes.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
pcx_content_type: changelog
33
title: Release notes
44
release_notes_file_name:
5-
- d1
5+
- ai-audit
66
sidebar:
77
order: 100
88
---

src/content/release-notes/ai-audit.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ link: "/ai-audit/changelog/"
33
productName: AI Audit
44
productLink: "/ai-audit/"
55
productArea: Core platform
6-
productAreaLink: /core/reference/changelog/security/
6+
productAreaLink: /fundamentals/reference/changelog/platform/
77
entries:
88
- publish_date: "2025-06-09"
99
title: Documentation for AI Audit

0 commit comments

Comments
 (0)