Skip to content

Commit aff005c

Browse files
mekarpelesmekarpeles
authored
Merge pull request internetarchive#11076 from internetarchive/cdrini-patch-3
Disallow crawling of /merges
2 parents e0eeb42 + 4c59bcc commit aff005c

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

‎static/robots.txt‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@ User-agent: *
33
Disallow: /api
44
Disallow: /edit
55
Disallow: /account
6+
Disallow: /merges
67
Disallow: /search
78
Disallow: /search/publishers
89
Disallow: /search/authors

0 commit comments

Comments
 (0)