Skip to content

Commit 427014e

Browse files
committed
don't disallow google image bot
checking if it affects adsense flow Signed-off-by: rishichawda <[email protected]>
1 parent 344b7dd commit 427014e

File tree

1 file changed

+0
-27
lines changed

1 file changed

+0
-27
lines changed

public/robots.txt

Lines changed: 0 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -2,32 +2,5 @@
22
User-agent: *
33
Allow: /
44

5-
# Block all bots from scraping images
6-
User-agent: *
7-
Disallow: /gallery/
8-
Disallow: *.jpg
9-
Disallow: *.jpeg
10-
Disallow: *.png
11-
Disallow: *.gif
12-
Disallow: *.webp
13-
Disallow: *.avif
14-
Disallow: *.svg
15-
16-
# Allow good bots (Google, Bing, etc.) to index pages with images
17-
User-agent: Googlebot
18-
User-agent: Googlebot-Image
19-
User-agent: Bingbot
20-
Allow: /
21-
22-
# Block image-specific crawlers
23-
User-agent: Googlebot-Image
24-
Disallow: /gallery/
25-
Disallow: *.jpg
26-
Disallow: *.jpeg
27-
Disallow: *.png
28-
Disallow: *.gif
29-
Disallow: *.webp
30-
Disallow: *.avif
31-
325
# Sitemap location
336
Sitemap: https://rishikc.com/sitemap-index.xml

0 commit comments

Comments
 (0)