Skip to content

Commit 753e65d

Browse files
authored
Update faq.mdx
update to include BR respects robots.txt
1 parent 205760f commit 753e65d

File tree

1 file changed

+2
-2
lines changed
  • src/content/docs/browser-rendering

1 file changed

+2
-2
lines changed

src/content/docs/browser-rendering/faq.mdx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,9 +18,9 @@ Make sure that you are passing your Browser binding to the `puppeteer.launch` ap
1818

1919
##### Will browser rendering bypass Cloudflare's Bot Protection?
2020

21-
Browser rendering requests are always identified as bots by Cloudflare.
21+
No, Browser Rendering requests are always identified as bots by Cloudflare and do not bypass Bot Protection. Additionally, Browser Rendering respects the robots.txt protocol, ensuring that any disallowed paths specified for user agents are not accessed during rendering.
2222

23-
If you are trying to **scan** your **own zone**, you can create a [WAF skip rule](/waf/custom-rules/skip/) to bypass the bot protection using a header or a custom user agent.
23+
If you are attempting to scan your **own zone** and need Browser Rendering to access areas protected by Cloudflare’s Bot Protection, you can create a [WAF skip rule](/waf/custom-rules/skip/) to bypass the bot protection using a header or a custom user agent.
2424

2525
## Puppeteer
2626

0 commit comments

Comments
 (0)