You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The AI Labyrinth adds invisible links on your webpage with specific `Nofollow` tags to block AI crawlers that do not adhere to the recommended guidelines and crawl without permission. AI crawlers that scrape your website content without permission will be stuck in a maze of never-ending links, and their details are recorded and used by all Cloudflare customers who choose to block [AI bots](/bots/concepts/bot/#ai-bots).
9
+
10
+
These links do not impact your search engine optimization (SEO) or your website's appearance, and are only seen by bots. AI bots that respect no-crawl instructions will safely ignore this honeypot.
Copy file name to clipboardExpand all lines: src/content/docs/bots/get-started/bot-management.mdx
+31-6Lines changed: 31 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,22 +28,47 @@ To enable a [Bot Management](https://dash.cloudflare.com/?to=/:account/:zone/sec
28
28
29
29
:::note
30
30
31
-
If you are not seeing Bot Management enabled on your zone or if you still see **Add Bot Management** on the Cloudflare dashboard, contact your account team for the proper entitlements.
31
+
If you are not seeing Bot Management enabled on your zone or if you still see **Add Bot Management** on the Cloudflare dashboard, contact your account team for the proper entitlements.
32
32
:::
33
33
34
-
## Block AI bots
34
+
## Setup
35
+
36
+
Cloudflare recommends that you deploy the following basic settings and customize them according to the traffic in your zone.
Enabling [JavaScript Detections](/bots/additional-configurations/javascript-detections/) validates that the browser can run JavaScript, and is stored in the `cf.bot_management.js_detection.passed` variable.
Cloudflare has [default templates](https://dash.cloudflare.com/?to=/:account/:zone/security/security-rules?template=bot_traffic) for definite bots, which we are very confident are automated (bot score 1) and likely bots that have many bot tells (bot score 2-29). In our templates, we recommend to allow verified bots like Google SEO crawler and access to static resources, which should be cached anyway.
63
+
64
+
-[Definite Bots template](https://dash.cloudflare.com/?to=/:account/:zone:/security/security-rules/custom-rules/create?template=Definitely%20Bots): Targets malicious bot traffic while ignoring verified bots and routes delivering static content.
65
+
66
+
`(cf.bot_management.score eq 1 and not cf.bot_management.verified_bot and not cf.bot_management.static_resource)`
67
+
68
+
-[Likely Bots template](https://dash.cloudflare.com/?to=/:account/:zone/security/security-rules/custom-rules/create?template=Likely%20Bots): Targets traffic likely to be malicious bots while ignoring verified bots and routes with static content. It may contain a small amount of non-bot traffic.
69
+
70
+
`(cf.bot_management.score ge 2 and cf.bot_management.score le 29 and not cf.bot_management.verified_bot and not cf.bot_management.static_resource)`
71
+
72
+
- (Optional) [JavaScript detections template](https://dash.cloudflare.com/?to=/:account/:zone/security/security-rules/custom-rules/create?template=JavaScript%20Verified%20URLs): If you enabled JavaScript detections, then set up a [managed challenge](/fundamentals/security/cloudflare-challenges/#managed-challenge-recommended), make sure to add a method and URI path. JavaScript detections improves security for URLs that should only expect JavaScript-enabled clients.
48
73
49
-
For more guidance on setup, refer to your Customer Success Manager.
74
+
`(not cf.bot_management.js_detection.passed and http.request.method eq "" and http.request.uri.path in {""})`
Copy file name to clipboardExpand all lines: src/content/docs/bots/reference/machine-learning-models.mdx
+4-9Lines changed: 4 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,16 +6,11 @@ sidebar:
6
6
7
7
---
8
8
9
-
## Enable Auto-updates to the Machine Learning Models
9
+
import { Render } from"~/components"
10
10
11
-
Cloudflare allows Enterprise customers to enable Auto-updates to its Machine Learning models for the newest bot detection models as they are released.
11
+
## Enable auto-updates to the Machine Learning models
12
12
13
-
To enable Auto-updates:
14
-
15
-
1. Log in to the Cloudflare dashboard and select your account and domain.
16
-
2. Go to **Security** > **Bots**.
17
-
3. Select **Configure Bot Management**.
18
-
4. Enable **Auto-updates to the Machine Learning Model**.
13
+
<Renderfile="latest-ml-model-enable" />
19
14
20
15
### What will change
21
16
@@ -38,4 +33,4 @@ By not updating to the latest version, you will be using a Machine Learning mode
38
33
| v5 | Recalibrated model for the [removal of `_cfduid` cookie](https://blog.cloudflare.com/deprecating-cfduid-cookie/). <br/><br/> Introduced new signals to reduce false negatives. | Q2 2021 |
39
34
| v6 | Significantly improved scoring for native Android application traffic. <br/><br/>Improved scoring on the newest versions of Chromium browsers. | Q1 2022 |
Copy file name to clipboardExpand all lines: src/content/partials/bots/ai-labyrinth-enable.mdx
+2-4Lines changed: 2 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,11 +5,9 @@ inputParameters: param1
5
5
6
6
import { Markdown } from"~/components"
7
7
8
-
The AI Labyrinth adds invisible links on your webpage with specific `Nofollow` tags to block AI crawlers that do not adhere to the recommended guidelines and crawl without permission. AI crawlers that scrape your website content without permission will be stuck in a maze of never-ending links, and their details are recorded and used by all Cloudflare customers who choose to block [AI bots](/bots/concepts/bot/#ai-bots).
8
+
AI Labyrinth decreases the accuracy and wastes the resources of AI Bots by confabulating articles on your website that are not visible to users.
9
9
10
-
These links do not impact your search engine optimization (SEO) or your website's appearance, and are only seen by bots. AI bots that respect no-crawl instructions will safely ignore this honeypot.
11
-
12
-
To enable AI Labyrinth:
10
+
To enable [AI Labyrinth](/bots/additional-configurations/ai-labyrinth):
13
11
14
12
1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/) and select your account and domain.
Cloudflare encourages Enterprise customers to enable auto-updates to its Machine Learning models to get the newest bot detection models as they are released.
9
+
10
+
To enable auto-updates:
11
+
12
+
1. Log in to the Cloudflare dashboard and select your account and domain.
13
+
2. Go to **Security** > **Bots**.
14
+
3. Select **Configure Bot Management**.
15
+
4. Enable **Auto-updates to the Machine Learning Model**.
0 commit comments