We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
2 parents 84547d7 + 486abda commit 04fdcccCopy full SHA for 04fdccc
public/robots-prod.txt
@@ -1,6 +1,7 @@
1
User-agent: *
2
Disallow: /mt/
3
Disallow: /profile/
4
+Disallow: /search?q=*
5
6
Sitemap: https://gothamist.com/sitemap.xml
-Sitemap: https://gothamist.com/sitemap-news.xml
7
+Sitemap: https://gothamist.com/sitemap-news.xml
0 commit comments