How to set WAF rules to allowlist AutoRAG crawler (#25332)

* How to set WAF rules to allowlist AutoRAG crawler

* update model in example

* Apply suggestions from code review

---------

Co-authored-by: Max Phillips <[email protected]>

Author: aninibread

src/content/docs/autorag/configuration/data-source/website.mdx

@@ -26,6 +26,19 @@ When you connect a domain, the crawler looks for your website’s sitemap to det
 
 Pages are visited, according to the `<priority>` attribute set on the sitemaps, if this field is defined.
 
+## How to set WAF rules to allowlist AutoRAG crawler
+
+If you have Security rules configured to block bot activity, you can add a rule to allowlist AutoRAG's crawler bot.
+
+1. Log in to the [Cloudflare dashboard](https://dash.cloudflare.com/) and select your account and domain.
+2. Go to **Security** > **Security rules**.
+3. To create a new empty rule, select **Create rule** > **Custom rules**.
+4. Enter a descriptive name for the rule in **Rule name**, such as `Allow AutoRAG`.
+5. Under **When incoming requests match**, use the **Field** drop-down list to choose _Bot Detection ID_. For **Operator**, select _equals_. For **Value**, enter `122933950`.
+6. Under **Then take action**, in the **Choose action** dropdown, choose _Skip_. 
+7. Under **Place at**, select the order of the rule in the **Select order** dropdown to be _First_. Setting the order as _First_ allows this rule to be applied before subsequent rules.
+8. To save and deploy your rule, select **Deploy**.
+
 ## Parsing options
 You can choose how pages are parsed during crawling:  
 

src/content/docs/autorag/usage/rest-api.mdx

@@ -44,7 +44,7 @@ curl https://api.cloudflare.com/client/v4/accounts/{ACCOUNT_ID}/autorag/rags/{AU
 -H "Authorization: Bearer {API_TOKEN}" \
 -d '{
 	"query": "How do I train a llama to deliver coffee?",
-	"model": @cf/meta/llama-3.3-70b-instruct-sd,
+	"model": @cf/meta/llama-3.3-70b-instruct-fp8-fast,
 	"rewrite_query": false,
 	"max_num_results": 10,
 	"ranking_options": {

src/content/docs/autorag/usage/workers-binding.mdx

@@ -36,7 +36,7 @@ This method searches for relevant results from your data source and generates a
 ```js
 const answer = await env.AI.autorag("my-autorag").aiSearch({
 	query: "How do I train a llama to deliver coffee?",
-	model: "@cf/meta/llama-3.3-70b-instruct-sd",
+	model: "@cf/meta/llama-3.3-70b-instruct-fp8-fast",
 	rewrite_query: true,
 	max_num_results: 2,
 	ranking_options: {