Skip to content

Commit 710cd75

Browse files
committed
Test
1 parent 440b4a2 commit 710cd75

File tree

1 file changed

+11
-0
lines changed

1 file changed

+11
-0
lines changed

src/content/docs/bots/additional-configurations/managed-robots-txt.mdx

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,17 @@ For example, without this feature enabled, the `robots.txt` content of `crawlsto
3333

3434
With the managed `robots.txt` enabled, Cloudflare will prepend our managed content before your original content, resulting in what you can view at https://crawlstop.com/robots.txt.
3535

36+
<div style="position: relative; padding-top: 56.25%">
37+
<iframe
38+
src="https://crawlstop.com/robots.txt"
39+
title="YouTube video player"
40+
allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share"
41+
style="border: none; position: absolute; top: 0; left: 0; height: 100%; width: 100%;"
42+
referrerpolicy="strict-origin-when-cross-origin"
43+
allowfullscreen
44+
></iframe>
45+
</div>
46+
3647
### No robots.txt file
3748

3849
If your website does not have a `robots.txt` file, Cloudflare creates a new file with our managed block directives and serves it for you.

0 commit comments

Comments
 (0)