Skip to content

Commit 5b165ca

Browse files
committed
Wording clarification.
1 parent ebf9e01 commit 5b165ca

File tree

2 files changed

+9
-1
lines changed

2 files changed

+9
-1
lines changed

src/content/docs/ai-audit/features/detect-ai-crawlers.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,6 @@ From the dropdown, select either **All subdomains**, or the specific subdomain y
4141
Selecting a specific subdomain allows you to access:
4242

4343
- **Violations only** toggle: Toggles the AI Audit page to only display bots which are violating your configured rules.
44-
- [**Enforce robots.txt policy**](/ai-audit/features/enforce-robots-txt/): Blocks bots which do not respect your `robots.txt`.
44+
- [**Enforce robots.txt policy**](/ai-audit/features/enforce-robots-txt/): Ensure bots cannot access webpages which are off-access, as specified in your `robots.txt` file.
4545

4646
The values of the AI Audit metrics will update according to your filter.

src/content/docs/ai-audit/index.mdx

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,14 @@ AI Audit is currently only available as a beta product.
4040
Displays information about AI crawlers in your domains' pages.
4141
</Feature>
4242

43+
<Feature
44+
header="Enforce robots.txt"
45+
href="/ai-audit/features/enforce-robots-txt/"
46+
cta="Enforce your robots.txt"
47+
>
48+
Enforce your `robots.txt` with a Cloudflare WAF rule.
49+
</Feature>
50+
4351
---
4452

4553
## Related Products

0 commit comments

Comments
 (0)