Skip to content

Commit 31935f8

Browse files
authored
feat(filter): Add naver.me / Yeti spider on the crawler filter list (#4602)
Closes: #4596
1 parent 2211a7b commit 31935f8

File tree

2 files changed

+4
-1
lines changed

2 files changed

+4
-1
lines changed

CHANGELOG.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@
55
**Features**:
66

77
- Add experimental playstation endpoint. ([#4555](https://github.com/getsentry/relay/pull/4555))
8+
- Add naver.me / Yeti spider on the crawler filter list. ([#4602](https://github.com/getsentry/relay/pull/4602))
89

910
**Internal**:
1011

relay-filter/src/web_crawlers.rs

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -34,7 +34,8 @@ static WEB_CRAWLERS: Lazy<Regex> = Lazy::new(|| {
3434
Cloudflare-Healthchecks| # Cloudflare Health Checks
3535
GTmetrix| # GTmetrix
3636
BrightEdgeOnCrawl| # BrightEdge - see https://www.brightedge.com/news/press-releases/brightedge-acquires-oncrawl-future-proof-web-30-strategies
37-
ELB-HealthChecker # AWS Elastic Load Balancing Health Checks
37+
ELB-HealthChecker| # AWS Elastic Load Balancing Health Checks
38+
naver.me/spd # Yeti/1.1 - naver.me
3839
"
3940
)
4041
.expect("Invalid web crawlers filter Regex")
@@ -126,6 +127,7 @@ mod tests {
126127
"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/117.0.0.0 Safari/537.36 GTmetrix",
127128
"Mozilla/5.0 (compatible; BrightEdgeOnCrawl/1.0; +http://www.oncrawl.com)",
128129
"ELB-HealthChecker/2.0",
130+
"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko; compatible; Yeti/1.1; +https://naver.me/spd) Chrome/127.0.0.0 Safari/537.36",
129131
];
130132

131133
for banned_user_agent in &user_agents {

0 commit comments

Comments
 (0)