You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/content/docs/ai-audit/configuration/ai-audit-with-waf.mdx
+20-6Lines changed: 20 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ sidebar:
6
6
7
7
---
8
8
9
-
import { GlossaryTooltip, Example, Steps } from"~/components";
9
+
import { GlossaryTooltip, Example, Steps, Tabs, TabItem } from"~/components";
10
10
11
11
AI Audit works alongside other Cloudflare products, such as Cloudflare [Web Application Firewall (WAF)](/waf/). WAF checks incoming web and API requests, and filters undesired traffic based on rules. [WAF custom rules](/waf/custom-rules/) allow you to perform certain actions such as enforcing <GlossaryTooltipterm="robots.txt">`robots.txt`</GlossaryTooltip>.
12
12
@@ -53,9 +53,9 @@ You may have both of the following features enabled:
53
53
-[WAF custom rule to allow search engine bots](/waf/custom-rules/use-cases/allow-traffic-from-verified-bots/)
54
54
- AI Audit's [pay per crawl](/ai-audit/features/pay-per-crawl/what-is-pay-per-crawl/) to charge all AI crawlers when they request access to your content (including search engine bots).
55
55
56
-
Since WAF custom rules are enforced before pay per crawl:
56
+
Since custom rules are enforced before pay per crawl:
57
57
58
-
- Only search engine bots will be able to access your site (enforced by WAF custom rule).
58
+
- Only search engine bots will be able to access your site (enforced by custom rule).
59
59
- The search engine bots will then be charged for access to your content (enforced by AI Audit's pay per crawl).
60
60
61
61
:::note
@@ -71,11 +71,25 @@ You may have both of the following features enabled:
71
71
- A WAF custom rule which blocks all bots.
72
72
- AI Audit selection which allows certain AI crawlers.
73
73
74
-
In this scenario, you have two WAF custom rules, each directing a different logic for handling AI crawlers. To resolve this issue:
74
+
In this scenario, you have two custom rules, each directing a different logic for handling AI crawlers. To resolve this issue:
0 commit comments