resolve conflicts

Author: aninibread

src/content/docs/ai-search/configuration/data-source/website.mdx

@@ -13,6 +13,10 @@ You can only crawl domains that you have onboarded onto the same Cloudflare acco
 Refer to [Onboard a domain](/fundamentals/manage-domains/add-site/) for more information on adding a domain to your Cloudflare account.
 :::
 
+:::caution[Bot protection may block crawling] 
+If you use Cloudflare products that control or restrict bot traffic such as [Bot Management](/bots/), [Web Application Firewall (WAF)](/waf/), or [Turnstile](/turnstile/), the same rules will apply to the AutoRAG crawler. Make sure to configure an exception or an allow-list for the AutoRAG crawler in your settings. 
+:::
+
 ## How website crawling works
 When you connect a domain, the crawler looks for your website’s sitemap to determine which pages to visit:
 

src/content/docs/ai-search/tutorial/brower-rendering-autorag-tutorial.mdx

@@ -15,6 +15,12 @@ In this tutorial, we’ll walk through how to:
 2. Store the rendered HTML in R2
 3. Connect it to AI Search for querying
 
+:::note
+
+AutoRAG now lets you use your [website](/ai-search/configuration/data-source/website/) as a data source. When enabled, AutoRAG will automatically crawl and parse your site content for you.
+
+:::
+
 ## Step 1. Create a Worker to fetch webpages and upload into R2
 
 We’ll create a Cloudflare Worker that uses Puppeteer to visit your URL, render it, and store the full HTML in your R2 bucket. If you already have an R2 bucket with content you’d like to build a RAG for then you can skip this step.