Skip to content

Commit 4efad73

Browse files
Update bots.ts
1 parent 0c700fd commit 4efad73

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

scripts/deno/bots.ts

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,11 @@ const { QueryExecutionId } = await client.send(
4444
WHERE year = ${date.year}
4545
AND month = ${String(date.month).padStart(2, "0")}
4646
AND day = ${String(date.day).padStart(2, "0")}
47-
AND request_user_agent NOT LIKE 'Guardian%'
47+
AND request_user_agent NOT LIKE 'Guardian/% CFNetwork%'
48+
AND request_user_agent NOT LIKE 'GuardianNews/%'
49+
AND request_user_agent NOT LIKE 'Guardian\%20Editions/%'
50+
AND response_status=200
51+
AND url != '/robots.txt'
4852
GROUP BY request_user_agent
4953
ORDER BY request_count desc
5054
LIMIT ${100_000}`,

0 commit comments

Comments
 (0)