Skip to content

Commit 33e3d8f

Browse files
ClaytonTDMClaytonTDM
authored
Add robots.txt to manage web crawler access
1 parent 0598dde commit 33e3d8f

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

‎robots.txt‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
User-agent: *
2+
Disallow: /cdn-cgi/
3+
Allow: /

0 commit comments

Comments
 (0)