Skip to content

Commit 9429a11

Browse files
committed
update crawler section name
1 parent 29fef5e commit 9429a11

File tree

1 file changed

+3
-3
lines changed
  • src/content/docs/ai-search/configuration/data-source

1 file changed

+3
-3
lines changed

src/content/docs/ai-search/configuration/data-source/website.mdx

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -29,17 +29,17 @@ When you connect a domain, the crawler looks for your website’s sitemap to det
2929

3030
Pages are visited, according to the `<priority>` attribute set on the sitemaps, if this field is defined.
3131

32-
## How to set WAF rules to allowlist AutoRAG crawler
32+
## How to set WAF rules to allowlist the crawler
3333

34-
If you have Security rules configured to block bot activity, you can add a rule to allowlist AutoRAG's crawler bot.
34+
If you have Security rules configured to block bot activity, you can add a rule to allowlist the crawler bot.
3535

3636
<Steps>
3737
1. In the Cloudflare dashboard, go to the **Security rules** page of your account and domain.
3838

3939
<DashButton url="/?to=/:account/:zone/security/security-rules" />
4040

4141
2. To create a new empty rule, select **Create rule** > **Custom rules**.
42-
3. Enter a descriptive name for the rule in **Rule name**, such as `Allow AutoRAG`.
42+
3. Enter a descriptive name for the rule in **Rule name**, such as `Allow AI Search`.
4343
4. Under **When incoming requests match**, use the **Field** drop-down list to choose _Bot Detection ID_. For **Operator**, select _equals_. For **Value**, enter `122933950`.
4444
5. Under **Then take action**, in the **Choose action** dropdown, choose _Skip_.
4545
6. Under **Place at**, select the order of the rule in the **Select order** dropdown to be _First_. Setting the order as _First_ allows this rule to be applied before subsequent rules.

0 commit comments

Comments
 (0)