Skip to content

Commit 04fdccc

Browse files
authored
Merge pull request #286 from nypublicradio/sguzik-robots-txt
Update robots.txt
2 parents 84547d7 + 486abda commit 04fdccc

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

public/robots-prod.txt

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,7 @@
11
User-agent: *
22
Disallow: /mt/
33
Disallow: /profile/
4+
Disallow: /search?q=*
45

56
Sitemap: https://gothamist.com/sitemap.xml
6-
Sitemap: https://gothamist.com/sitemap-news.xml
7+
Sitemap: https://gothamist.com/sitemap-news.xml

0 commit comments

Comments
 (0)