Skip to content

Commit 8418c01

Browse files
committed
update robots.txt
1 parent 84f1c1f commit 8418c01

File tree

1 file changed

+1
-62
lines changed

1 file changed

+1
-62
lines changed

public/robots.txt

Lines changed: 1 addition & 62 deletions
Original file line numberDiff line numberDiff line change
@@ -1,65 +1,4 @@
11
User-agent: *
2-
Allow: /
3-
4-
User-agent: Googlebot
5-
Allow: /
6-
7-
User-agent: Bingbot
8-
Allow: /
9-
10-
User-agent: Slurp
11-
Allow: /
12-
13-
User-agent: DuckDuckBot
14-
Allow: /
15-
16-
User-agent: Baiduspider
17-
Allow: /
18-
19-
User-agent: YandexBot
20-
Allow: /
21-
22-
User-agent: NaverBot
23-
Allow: /
24-
25-
User-agent: Seznambot
26-
Allow: /
27-
28-
User-agent: Applebot
29-
Allow: /
30-
31-
User-agent: facebookexternalhit
32-
Allow: /
33-
34-
User-agent: Twitterbot
35-
Allow: /
36-
37-
User-agent: LinkedInBot
38-
Allow: /
39-
40-
User-agent: WhatsApp
41-
Allow: /
42-
43-
User-agent: TelegramBot
44-
Allow: /
45-
46-
User-agent: DiscordBot
47-
Allow: /
48-
49-
User-agent: SlackBot
50-
Allow: /
51-
52-
User-agent: ChatGPT-User
53-
Allow: /
54-
55-
User-agent: GPTBot
56-
Allow: /
57-
58-
User-agent: Claude-Web
59-
Allow: /
60-
61-
User-agent: PerplexityBot
62-
Allow: /
2+
Disallow:
633

644
Sitemap: https://chinmay29hub-stegmoji.vercel.app/sitemap.xml
65-

0 commit comments

Comments
 (0)