Skip to content

Commit 6c22c0a

Browse files
committed
Add another AI crawler to robots.txt
1 parent 2f908e8 commit 6c22c0a

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/main/resources/public/robots.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ User-agent: CCBot
99
User-agent: ChatGPT-User
1010
User-agent: Claude-Web
1111
User-agent: ClaudeBot
12+
User-agent: Claude-SearchBot
1213
User-agent: cohere-ai
1314
User-agent: cohere-training-data-crawler
1415
User-agent: Crawlspace

0 commit comments

Comments
 (0)