Restore slash to disallow rule

jsha · jsha · commit 98a797e2e35d · 2024-12-20T14:22:32.000-08:00
diff --git a/static/robots.txt b/static/robots.txt
@@ -3,5 +3,5 @@ Sitemap: https://docs.rs/sitemap.xml
 # confuse Google's duplicate detection, so we block crawling them.
 # https://docs.rs/about/redirections
 User-Agent: *
-Disallow: *^
-Disallow: *~
+Disallow: */^
+Disallow: */~
