We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 344b7dd commit 427014eCopy full SHA for 427014e
public/robots.txt
@@ -2,32 +2,5 @@
2
User-agent: *
3
Allow: /
4
5
-# Block all bots from scraping images
6
-User-agent: *
7
-Disallow: /gallery/
8
-Disallow: *.jpg
9
-Disallow: *.jpeg
10
-Disallow: *.png
11
-Disallow: *.gif
12
-Disallow: *.webp
13
-Disallow: *.avif
14
-Disallow: *.svg
15
-
16
-# Allow good bots (Google, Bing, etc.) to index pages with images
17
-User-agent: Googlebot
18
-User-agent: Googlebot-Image
19
-User-agent: Bingbot
20
-Allow: /
21
22
-# Block image-specific crawlers
23
24
25
26
27
28
29
30
31
32
# Sitemap location
33
Sitemap: https://rishikc.com/sitemap-index.xml
0 commit comments