Skip to content

Commit 2f018dd

Browse files
mitchellkrogzamitchellkrogza
committed
V3.2021.06.1210 [ci skip]
1 parent bf295da commit 2f018dd

File tree

25 files changed

+119
-73
lines changed

25 files changed

+119
-73
lines changed

‎.dev-tools/_htaccess_generator_files/bad-user-agents.list‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -425,6 +425,7 @@ ScoutJet
425425
Scrapy
426426
Screaming
427427
ScreenerBot
428+
ScrepyBot
428429
Searchestate
429430
SearchmetricsBot
430431
Semrush
@@ -526,6 +527,7 @@ URLy\ Warning
526527
URLy\.Warning
527528
Vacuum
528529
Vagabondo
530+
V\-BOT
529531
VB\ Project
530532
VCI
531533
VelenPublicWebCrawler
@@ -535,6 +537,7 @@ Virusdie
535537
VoidEYE
536538
Voil
537539
Voltron
540+
voyagerx\.com
538541
Wallpapers\/3\.0
539542
WallpapersHD
540543
WASALive\-Bot

‎.dev-tools/_robots_generator_files/robots.list‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -425,6 +425,7 @@ ScoutJet
425425
Scrapy
426426
Screaming
427427
ScreenerBot
428+
ScrepyBot
428429
Searchestate
429430
SearchmetricsBot
430431
Semrush
@@ -526,6 +527,7 @@ URLy Warning
526527
URLy.Warning
527528
Vacuum
528529
Vagabondo
530+
V-BOT
529531
VB Project
530532
VCI
531533
VelenPublicWebCrawler
@@ -535,6 +537,7 @@ Virusdie
535537
VoidEYE
536538
Voil
537539
Voltron
540+
voyagerx.com
538541
Wallpapers/3.0
539542
WallpapersHD
540543
WASALive-Bot

‎.dev-tools/_test_results/_conf_files_2.2/globalblacklist.conf‎

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -16,10 +16,10 @@
1616

1717
### Version Information #
1818
###################################################
19-
### Version: V3.2021.06.1209
20-
### Updated: Fri Jun 11 15:46:06 SAST 2021
21-
### Bad Referrer Count: 7059
22-
### Bad Bot Count: 612
19+
### Version: V3.2021.06.1210
20+
### Updated: Mon Jun 14 11:53:23 SAST 2021
21+
### Bad Referrer Count: 7060
22+
### Bad Bot Count: 615
2323
###################################################
2424
### Version Information ##
2525

@@ -600,6 +600,7 @@ BrowserMatchNoCase "(?:\b)ScoutJet(?:\b)" bad_bot
600600
BrowserMatchNoCase "(?:\b)Scrapy(?:\b)" bad_bot
601601
BrowserMatchNoCase "(?:\b)Screaming(?:\b)" bad_bot
602602
BrowserMatchNoCase "(?:\b)ScreenerBot(?:\b)" bad_bot
603+
BrowserMatchNoCase "(?:\b)ScrepyBot(?:\b)" bad_bot
603604
BrowserMatchNoCase "(?:\b)Searchestate(?:\b)" bad_bot
604605
BrowserMatchNoCase "(?:\b)SearchmetricsBot(?:\b)" bad_bot
605606
BrowserMatchNoCase "(?:\b)Semrush(?:\b)" bad_bot
@@ -701,6 +702,7 @@ BrowserMatchNoCase "(?:\b)URLy.Warning(?:\b)" bad_bot
701702
BrowserMatchNoCase "(?:\b)URLy\ Warning(?:\b)" bad_bot
702703
BrowserMatchNoCase "(?:\b)Vacuum(?:\b)" bad_bot
703704
BrowserMatchNoCase "(?:\b)Vagabondo(?:\b)" bad_bot
705+
BrowserMatchNoCase "(?:\b)V-BOT(?:\b)" bad_bot
704706
BrowserMatchNoCase "(?:\b)VB\ Project(?:\b)" bad_bot
705707
BrowserMatchNoCase "(?:\b)VCI(?:\b)" bad_bot
706708
BrowserMatchNoCase "(?:\b)VelenPublicWebCrawler(?:\b)" bad_bot
@@ -710,6 +712,7 @@ BrowserMatchNoCase "(?:\b)Virusdie(?:\b)" bad_bot
710712
BrowserMatchNoCase "(?:\b)VoidEYE(?:\b)" bad_bot
711713
BrowserMatchNoCase "(?:\b)Voil(?:\b)" bad_bot
712714
BrowserMatchNoCase "(?:\b)Voltron(?:\b)" bad_bot
715+
BrowserMatchNoCase "(?:\b)voyagerx.com(?:\b)" bad_bot
713716
BrowserMatchNoCase "(?:\b)Wallpapers/3.0(?:\b)" bad_bot
714717
BrowserMatchNoCase "(?:\b)WallpapersHD(?:\b)" bad_bot
715718
BrowserMatchNoCase "(?:\b)WASALive-Bot(?:\b)" bad_bot
@@ -6119,6 +6122,7 @@ SetEnvIfNoCase Referer ~*scottbywater\.com spam_ref
61196122
SetEnvIfNoCase Referer ~*scrapinghub\.com spam_ref
61206123
SetEnvIfNoCase Referer ~*scrapy\.org spam_ref
61216124
SetEnvIfNoCase Referer ~*screentoolkit\.com spam_ref
6125+
SetEnvIfNoCase Referer ~*screpy\.com spam_ref
61226126
SetEnvIfNoCase Referer ~*scripted\.com spam_ref
61236127
SetEnvIfNoCase Referer ~*scrnet\.biz\.ua spam_ref
61246128
SetEnvIfNoCase Referer ~*sc\-specialhost\.com spam_ref

‎.dev-tools/_test_results/_conf_files_2.4/globalblacklist.conf‎

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -16,10 +16,10 @@
1616

1717
### Version Information #
1818
###################################################
19-
### Version: V3.2021.06.1209
20-
### Updated: Fri Jun 11 15:46:06 SAST 2021
21-
### Bad Referrer Count: 7059
22-
### Bad Bot Count: 612
19+
### Version: V3.2021.06.1210
20+
### Updated: Mon Jun 14 11:53:23 SAST 2021
21+
### Bad Referrer Count: 7060
22+
### Bad Bot Count: 615
2323
###################################################
2424
### Version Information ##
2525

@@ -593,6 +593,7 @@ BrowserMatchNoCase "(?:\b)ScoutJet(?:\b)" bad_bot
593593
BrowserMatchNoCase "(?:\b)Scrapy(?:\b)" bad_bot
594594
BrowserMatchNoCase "(?:\b)Screaming(?:\b)" bad_bot
595595
BrowserMatchNoCase "(?:\b)ScreenerBot(?:\b)" bad_bot
596+
BrowserMatchNoCase "(?:\b)ScrepyBot(?:\b)" bad_bot
596597
BrowserMatchNoCase "(?:\b)Searchestate(?:\b)" bad_bot
597598
BrowserMatchNoCase "(?:\b)SearchmetricsBot(?:\b)" bad_bot
598599
BrowserMatchNoCase "(?:\b)Semrush(?:\b)" bad_bot
@@ -694,6 +695,7 @@ BrowserMatchNoCase "(?:\b)URLy.Warning(?:\b)" bad_bot
694695
BrowserMatchNoCase "(?:\b)URLy\ Warning(?:\b)" bad_bot
695696
BrowserMatchNoCase "(?:\b)Vacuum(?:\b)" bad_bot
696697
BrowserMatchNoCase "(?:\b)Vagabondo(?:\b)" bad_bot
698+
BrowserMatchNoCase "(?:\b)V-BOT(?:\b)" bad_bot
697699
BrowserMatchNoCase "(?:\b)VB\ Project(?:\b)" bad_bot
698700
BrowserMatchNoCase "(?:\b)VCI(?:\b)" bad_bot
699701
BrowserMatchNoCase "(?:\b)VelenPublicWebCrawler(?:\b)" bad_bot
@@ -703,6 +705,7 @@ BrowserMatchNoCase "(?:\b)Virusdie(?:\b)" bad_bot
703705
BrowserMatchNoCase "(?:\b)VoidEYE(?:\b)" bad_bot
704706
BrowserMatchNoCase "(?:\b)Voil(?:\b)" bad_bot
705707
BrowserMatchNoCase "(?:\b)Voltron(?:\b)" bad_bot
708+
BrowserMatchNoCase "(?:\b)voyagerx.com(?:\b)" bad_bot
706709
BrowserMatchNoCase "(?:\b)Wallpapers/3.0(?:\b)" bad_bot
707710
BrowserMatchNoCase "(?:\b)WallpapersHD(?:\b)" bad_bot
708711
BrowserMatchNoCase "(?:\b)WASALive-Bot(?:\b)" bad_bot
@@ -6115,6 +6118,7 @@ SetEnvIfNoCase Referer ~*scottbywater\.com spam_ref
61156118
SetEnvIfNoCase Referer ~*scrapinghub\.com spam_ref
61166119
SetEnvIfNoCase Referer ~*scrapy\.org spam_ref
61176120
SetEnvIfNoCase Referer ~*screentoolkit\.com spam_ref
6121+
SetEnvIfNoCase Referer ~*screpy\.com spam_ref
61186122
SetEnvIfNoCase Referer ~*scripted\.com spam_ref
61196123
SetEnvIfNoCase Referer ~*scrnet\.biz\.ua spam_ref
61206124
SetEnvIfNoCase Referer ~*sc\-specialhost\.com spam_ref

‎.dev-tools/apache2.2.template‎

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -16,10 +16,10 @@
1616

1717
### Version Information #
1818
###################################################
19-
### Version: V3.2021.06.1209
20-
### Updated: Fri Jun 11 15:46:06 SAST 2021
21-
### Bad Referrer Count: 7059
22-
### Bad Bot Count: 612
19+
### Version: V3.2021.06.1210
20+
### Updated: Mon Jun 14 11:53:23 SAST 2021
21+
### Bad Referrer Count: 7060
22+
### Bad Bot Count: 615
2323
###################################################
2424
### Version Information ##
2525

@@ -600,6 +600,7 @@ BrowserMatchNoCase "(?:\b)ScoutJet(?:\b)" bad_bot
600600
BrowserMatchNoCase "(?:\b)Scrapy(?:\b)" bad_bot
601601
BrowserMatchNoCase "(?:\b)Screaming(?:\b)" bad_bot
602602
BrowserMatchNoCase "(?:\b)ScreenerBot(?:\b)" bad_bot
603+
BrowserMatchNoCase "(?:\b)ScrepyBot(?:\b)" bad_bot
603604
BrowserMatchNoCase "(?:\b)Searchestate(?:\b)" bad_bot
604605
BrowserMatchNoCase "(?:\b)SearchmetricsBot(?:\b)" bad_bot
605606
BrowserMatchNoCase "(?:\b)Semrush(?:\b)" bad_bot
@@ -701,6 +702,7 @@ BrowserMatchNoCase "(?:\b)URLy.Warning(?:\b)" bad_bot
701702
BrowserMatchNoCase "(?:\b)URLy\ Warning(?:\b)" bad_bot
702703
BrowserMatchNoCase "(?:\b)Vacuum(?:\b)" bad_bot
703704
BrowserMatchNoCase "(?:\b)Vagabondo(?:\b)" bad_bot
705+
BrowserMatchNoCase "(?:\b)V-BOT(?:\b)" bad_bot
704706
BrowserMatchNoCase "(?:\b)VB\ Project(?:\b)" bad_bot
705707
BrowserMatchNoCase "(?:\b)VCI(?:\b)" bad_bot
706708
BrowserMatchNoCase "(?:\b)VelenPublicWebCrawler(?:\b)" bad_bot
@@ -710,6 +712,7 @@ BrowserMatchNoCase "(?:\b)Virusdie(?:\b)" bad_bot
710712
BrowserMatchNoCase "(?:\b)VoidEYE(?:\b)" bad_bot
711713
BrowserMatchNoCase "(?:\b)Voil(?:\b)" bad_bot
712714
BrowserMatchNoCase "(?:\b)Voltron(?:\b)" bad_bot
715+
BrowserMatchNoCase "(?:\b)voyagerx.com(?:\b)" bad_bot
713716
BrowserMatchNoCase "(?:\b)Wallpapers/3.0(?:\b)" bad_bot
714717
BrowserMatchNoCase "(?:\b)WallpapersHD(?:\b)" bad_bot
715718
BrowserMatchNoCase "(?:\b)WASALive-Bot(?:\b)" bad_bot
@@ -6119,6 +6122,7 @@ SetEnvIfNoCase Referer ~*scottbywater\.com spam_ref
61196122
SetEnvIfNoCase Referer ~*scrapinghub\.com spam_ref
61206123
SetEnvIfNoCase Referer ~*scrapy\.org spam_ref
61216124
SetEnvIfNoCase Referer ~*screentoolkit\.com spam_ref
6125+
SetEnvIfNoCase Referer ~*screpy\.com spam_ref
61226126
SetEnvIfNoCase Referer ~*scripted\.com spam_ref
61236127
SetEnvIfNoCase Referer ~*scrnet\.biz\.ua spam_ref
61246128
SetEnvIfNoCase Referer ~*sc\-specialhost\.com spam_ref

‎.dev-tools/apache2.4.template‎

Lines changed: 8 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -16,10 +16,10 @@
1616

1717
### Version Information #
1818
###################################################
19-
### Version: V3.2021.06.1209
20-
### Updated: Fri Jun 11 15:46:06 SAST 2021
21-
### Bad Referrer Count: 7059
22-
### Bad Bot Count: 612
19+
### Version: V3.2021.06.1210
20+
### Updated: Mon Jun 14 11:53:23 SAST 2021
21+
### Bad Referrer Count: 7060
22+
### Bad Bot Count: 615
2323
###################################################
2424
### Version Information ##
2525

@@ -593,6 +593,7 @@ BrowserMatchNoCase "(?:\b)ScoutJet(?:\b)" bad_bot
593593
BrowserMatchNoCase "(?:\b)Scrapy(?:\b)" bad_bot
594594
BrowserMatchNoCase "(?:\b)Screaming(?:\b)" bad_bot
595595
BrowserMatchNoCase "(?:\b)ScreenerBot(?:\b)" bad_bot
596+
BrowserMatchNoCase "(?:\b)ScrepyBot(?:\b)" bad_bot
596597
BrowserMatchNoCase "(?:\b)Searchestate(?:\b)" bad_bot
597598
BrowserMatchNoCase "(?:\b)SearchmetricsBot(?:\b)" bad_bot
598599
BrowserMatchNoCase "(?:\b)Semrush(?:\b)" bad_bot
@@ -694,6 +695,7 @@ BrowserMatchNoCase "(?:\b)URLy.Warning(?:\b)" bad_bot
694695
BrowserMatchNoCase "(?:\b)URLy\ Warning(?:\b)" bad_bot
695696
BrowserMatchNoCase "(?:\b)Vacuum(?:\b)" bad_bot
696697
BrowserMatchNoCase "(?:\b)Vagabondo(?:\b)" bad_bot
698+
BrowserMatchNoCase "(?:\b)V-BOT(?:\b)" bad_bot
697699
BrowserMatchNoCase "(?:\b)VB\ Project(?:\b)" bad_bot
698700
BrowserMatchNoCase "(?:\b)VCI(?:\b)" bad_bot
699701
BrowserMatchNoCase "(?:\b)VelenPublicWebCrawler(?:\b)" bad_bot
@@ -703,6 +705,7 @@ BrowserMatchNoCase "(?:\b)Virusdie(?:\b)" bad_bot
703705
BrowserMatchNoCase "(?:\b)VoidEYE(?:\b)" bad_bot
704706
BrowserMatchNoCase "(?:\b)Voil(?:\b)" bad_bot
705707
BrowserMatchNoCase "(?:\b)Voltron(?:\b)" bad_bot
708+
BrowserMatchNoCase "(?:\b)voyagerx.com(?:\b)" bad_bot
706709
BrowserMatchNoCase "(?:\b)Wallpapers/3.0(?:\b)" bad_bot
707710
BrowserMatchNoCase "(?:\b)WallpapersHD(?:\b)" bad_bot
708711
BrowserMatchNoCase "(?:\b)WASALive-Bot(?:\b)" bad_bot
@@ -6115,6 +6118,7 @@ SetEnvIfNoCase Referer ~*scottbywater\.com spam_ref
61156118
SetEnvIfNoCase Referer ~*scrapinghub\.com spam_ref
61166119
SetEnvIfNoCase Referer ~*scrapy\.org spam_ref
61176120
SetEnvIfNoCase Referer ~*screentoolkit\.com spam_ref
6121+
SetEnvIfNoCase Referer ~*screpy\.com spam_ref
61186122
SetEnvIfNoCase Referer ~*scripted\.com spam_ref
61196123
SetEnvIfNoCase Referer ~*scrnet\.biz\.ua spam_ref
61206124
SetEnvIfNoCase Referer ~*sc\-specialhost\.com spam_ref

‎.dev-tools/referrers-regex-format.txt‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5194,6 +5194,7 @@ SetEnvIfNoCase Referer ~*scottbywater\.com spam_ref
51945194
SetEnvIfNoCase Referer ~*scrapinghub\.com spam_ref
51955195
SetEnvIfNoCase Referer ~*scrapy\.org spam_ref
51965196
SetEnvIfNoCase Referer ~*screentoolkit\.com spam_ref
5197+
SetEnvIfNoCase Referer ~*screpy\.com spam_ref
51975198
SetEnvIfNoCase Referer ~*scripted\.com spam_ref
51985199
SetEnvIfNoCase Referer ~*scrnet\.biz\.ua spam_ref
51995200
SetEnvIfNoCase Referer ~*sc\-specialhost\.com spam_ref

‎.dev-tools/test_units/random-bots-for-test-quick.list‎

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,10 @@
1-
Alexibot
2-
Attach
3-
IDBot
4-
IDBTE4M
5-
RankActiveLinkBot
6-
Recorder
7-
SentiBot
8-
SMTBot
9-
Spbot
10-
WWWOFFLE
1+
80legs
2+
Anarchie
3+
BuiltBotTough
4+
CopyRightCheck
5+
eCatch
6+
lwp-trivial
7+
Magnet
8+
NetSpider
9+
Nettrack
10+
ripz

‎.dev-tools/test_units/random-referrers-for-test-quick.list‎

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,10 @@
1-
blog.axant.it
2-
chatroulette.world
3-
diy-handmade-ideas.com
4-
doreenblog.online
5-
froggytube.com
6-
katjimej.blog.fc2.com
7-
krafte.ru
8-
pastaleads.com
9-
seocheckupx.com
10-
webadvance.club
1+
autotrends.today
2+
bestprofits-there.com
3+
bronzeaid-a.akamaihd.net
4+
dividendo.ru
5+
ictizanidinehcl4mg.blogspot.com
6+
mackeeper-center.club
7+
pc-virus-d0l92j2.pw
8+
seeingmeerkat.com
9+
stretchmate.net
10+
zeroredirect1.com

‎.latest_release/Apache_2.2.tar.gz‎

22 Bytes
Binary file not shown.

0 commit comments

Comments
 (0)