We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 2f908e8 commit 6c22c0aCopy full SHA for 6c22c0a
src/main/resources/public/robots.txt
@@ -9,6 +9,7 @@ User-agent: CCBot
9
User-agent: ChatGPT-User
10
User-agent: Claude-Web
11
User-agent: ClaudeBot
12
+User-agent: Claude-SearchBot
13
User-agent: cohere-ai
14
User-agent: cohere-training-data-crawler
15
User-agent: Crawlspace
0 commit comments