Skip to content

Commit 6a6456a

Browse files
authored
Update faq.mdx
remove robots.txt language
1 parent 2cb316f commit 6a6456a

File tree

1 file changed

+1
-1
lines changed
  • src/content/docs/browser-rendering

1 file changed

+1
-1
lines changed

src/content/docs/browser-rendering/faq.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ To resolve: Pass your Browser binding into `puppeteer.launch`.
2020

2121
### Will Browser Rendering bypass Cloudflare's Bot Protection?
2222

23-
No, Browser Rendering requests are always identified as bots by Cloudflare and do not bypass Bot Protection. Additionally, Browser Rendering respects the robots.txt protocol, ensuring that any disallowed paths specified for user agents are not accessed during rendering.
23+
No, Browser Rendering requests are always identified as bots by Cloudflare and do not bypass Bot Protection.
2424

2525
If you are attempting to scan your **own zone** and need Browser Rendering to access areas protected by Cloudflare’s Bot Protection, you can create a [WAF skip rule](/waf/custom-rules/skip/) to bypass the bot protection using a header or a custom user agent.
2626

0 commit comments

Comments
 (0)