Skip to content

Commit 6fdd685

Browse files
Update src/content/docs/ai-crawl-control/features/track-robots-txt.mdx
1 parent c761638 commit 6fdd685

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/content/docs/ai-crawl-control/features/track-robots-txt.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ The **Availability** table shows the historical request frequency and health sta
4242
| Column | Description |
4343
| --------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
4444
| Path | The specific hostname's `robots.txt` file being requested. Paths are organized by most requested first. |
45-
| Requests | The total number of requests made to this path. Requests are broken down into:<br/>- **Allowed:** HTTP status codes below 400 (including **200 OK** and redirects).<br/>- **Unsuccessful:** HTTP status codes of 400 or above. |
45+
| Requests | The total number of requests made to this path. Requests are broken down into:<br/>- **Successful:** HTTP status codes below 400 (including **200 OK** and redirects).<br/>- **Unsuccessful:** HTTP status codes of 400 or above. |
4646
| Status | The HTTP status code from pinging the `robots.txt` file. |
4747
| Content Signals | An indicator showing whether the `robots.txt` file contains [Content Signals](https://contentsignals.org/), directives for usage in AI training, search, or AI input. |
4848

0 commit comments

Comments
 (0)