Skip to content

Commit d6b177b

Browse files
[Github Action] Automated trickest wordlists update.
1 parent 83f4008 commit d6b177b

File tree

1 file changed

+45
-45
lines changed
  • Discovery/Web-Content/trickest-robots-disallowed-wordlists

1 file changed

+45
-45
lines changed

Discovery/Web-Content/trickest-robots-disallowed-wordlists/top-10000.txt

Lines changed: 45 additions & 45 deletions
Original file line numberDiff line numberDiff line change
@@ -28212,7 +28212,7 @@ GuideRequested
2821228212
GuideRequestor
2821328213
H
2821428214
HACAffiliate
28215-
HBO/
28215+
HBO/
2821628216
HK/
2821728217
HM
2821828218
HMDThankYou
@@ -41299,7 +41299,7 @@ actuator
4129941299
actuator/http://pearltrees.com/robots.txt
4130041300
ad
4130141301
ad-blocker-performance-study-in-response-to-manifest-v3-finds-that-ghosterys-ad-blocker-beats-the-competition
41302-
ad-manager/
41302+
ad-manager/
4130341303
ad-retargeting-101-online-shopping-in-the-covid-19-era
4130441304
ad-scans
4130541305
ad-test
@@ -42043,7 +42043,7 @@ agile064
4204342043
agile065
4204442044
agile066
4204542045
agile067
42046-
agility/
42046+
agility/
4204742047
aging_surprises_getting_older/article.htm
4204842048
agiraudy
4204942049
aglassie
@@ -43359,7 +43359,7 @@ anewleaf
4335943359
anfrage
4336043360
anfrage-oeffnungszeiten
4336143361
ang
43362-
anga/
43362+
anga/
4336343363
angebot
4336443364
angebot-details
4336543365
angebote
@@ -44276,7 +44276,7 @@ applicant-eligibility
4427644276
applicant-registration
4427744277
application
4427844278
application*
44279-
application-content/
44279+
application-content/
4428044280
application-mobile-la-poste/content
4428144281
application-survey/
4428244282
application/
@@ -45483,7 +45483,7 @@ asosinsky
4548345483
asouri
4548445484
asp.net/
4548545485
asp/
45486-
asp/
45486+
asp/
4548745487
asp/*
4548845488
asp/*http://allrecipes.com/robots.txt
4548945489
asp/*http://art19.com/robots.txt
@@ -45495,7 +45495,7 @@ aspWebCalendar/
4549545495
aspnet_client
4549645496
aspnet_client
4549745497
aspnet_client/
45498-
aspnet_client/
45498+
aspnet_client/
4549945499
aspwebcalendar/
4550045500
aspwebcalendar/calendar.asp
4550145501
aspx$
@@ -46992,7 +46992,7 @@ banners
4699246992
banners-old.php?
4699346993
banners.aspx
4699446994
banners/
46995-
banners/
46995+
banners/
4699646996
banners/link-default.html
4699746997
banners/obama-vs-romney.html
4699846998
banners2/
@@ -61766,7 +61766,7 @@ cloud-setup
6176661766
cloud-storage-pricing-plans/*
6176761767
cloud-update-instructions
6176861768
cloud/
61769-
cloud/
61769+
cloud/
6177061770
cloud/$
6177161771
cloud/*
6177261772
cloud/131
@@ -66588,7 +66588,7 @@ contentassets/*.xml$
6658866588
contentfeed/getdata?type=synopsi
6658966589
contentisblocked
6659066590
contentisblocked.md
66591-
contentjam/
66591+
contentjam/
6659266592
contentonly
6659366593
contentpar_gridblock
6659466594
contentresearchtool/
@@ -74186,7 +74186,7 @@ downloadpubliclightbox.php
7418674186
downloads
7418774187
downloads.php
7418874188
downloads/
74189-
downloads/
74189+
downloads/
7419074190
downloads/$
7419174191
downloads/*
7419274192
downloads/*/
@@ -74281,7 +74281,7 @@ dritte
7428174281
drive
7428274282
drive-and-listen/
7428374283
drive-angry
74284-
drive-in/
74284+
drive-in/
7428574285
drive-with-lyft*ref=
7428674286
drive-with-lyft*utm
7428774287
drive/car-reviews/*/new
@@ -79482,10 +79482,10 @@ epilepsy_pictures_slideshow/article.htm
7948279482
episerver
7948379483
episerver
7948479484
episode
79485-
episode-engine/
79486-
episode-podcast/
79485+
episode-engine/
79486+
episode-podcast/
79487+
episode/
7948779488
episode/
79488-
episode/
7948979489
episode/*/transcript$
7949079490
episode/http
7949179491
episodes
@@ -84103,7 +84103,7 @@ filter/more
8410384103
filter/tip
8410484104
filter/tips
8410584105
filter/tips
84106-
filter/tips
84106+
filter/tips
8410784107
filter/tips/
8410884108
filter=
8410984109
filter=*
@@ -84463,7 +84463,7 @@ flightsh5/
8446384463
flightstat/v1
8446484464
flint-deals
8446584465
flip-book/pdf/ad106c9390e50a84a1f87bed55b5115b712d9c6b.pdf
84466-
flip-player/
84466+
flip-player/
8446784467
flip-preview
8446884468
flipboardrss
8446984469
flipbook
@@ -95896,7 +95896,7 @@ html?pageq=
9589695896
html?pages=
9589795897
html?ref=
9589895898
html?user_country=
95899-
html_email/
95899+
html_email/
9590095900
html_externe
9590195901
html_helpers
9590295902
html_templates
@@ -98112,7 +98112,7 @@ include_xml/*
9811298112
includes
9811398113
includes.other/
9811498114
includes/
98115-
includes/
98115+
includes/
9811698116
includes/*.js
9811798117
includes/_stampa_articolo.php*
9811898118
includes/boite/1
@@ -98304,7 +98304,7 @@ index.php/facets-block-ajax
9830498304
index.php/filter/tip
9830598305
index.php/filter/tips
9830698306
index.php/filter/tips
98307-
index.php/filter/tips
98307+
index.php/filter/tips
9830898308
index.php/filter/tips/
9830998309
index.php/fusion-search
9831098310
index.php/game-reviews/*/user-reviews/manage/add
@@ -98359,7 +98359,7 @@ index.php/search
9835998359
index.php/search-results
9836098360
index.php/search-seeds
9836198361
index.php/search/
98362-
index.php/search/
98362+
index.php/search/
9836398363
index.php/search?
9836498364
index.php/site-search
9836598365
index.php/site_search
@@ -99485,7 +99485,7 @@ ipAcl
9948599485
ipad
9948699486
ipad-games/buy/*
9948799487
ipad/
99488-
ipad/
99488+
ipad/
9948999489
ipad/4/Contents/en/searchindex
9949099490
ipadconsent
9949199491
ipaddownload
@@ -104703,7 +104703,7 @@ lan
104703104703
lancaster
104704104704
land
104705104705
land-browse-bff
104706-
land/
104706+
land/
104707104707
land/*/reviews
104708104708
land/*/sites/*/photos
104709104709
landes/
@@ -104721,7 +104721,7 @@ landing-page/webinar/kessler-expertserieswebinar-mojo-assetdeliveryhttp://curbed
104721104721
landing-pages/
104722104722
landing.php
104723104723
landing/
104724-
landing/
104724+
landing/
104725104725
landing/CME-channel
104726104726
landing/VillageMD
104727104727
landing/athenaclinicals
@@ -104945,7 +104945,7 @@ latoyaprincessjackson
104945104945
launch-academy
104946104946
launch-learn-more-vid
104947104947
launch.aspx
104948-
launch/
104948+
launch/
104949104949
launch2005/
104950104950
launchpad
104951104951
launchpad/*css
@@ -109157,7 +109157,7 @@ map
109157109157
map
109158109158
map-constructor/loader
109159109159
map-regular.xml
109160-
map-review/
109160+
map-review/
109161109161
map-videofull.xml
109162109162
map.ashx
109163109163
map.asp
@@ -109318,7 +109318,7 @@ margaretjenkins
109318109318
margarettroyer
109319109319
marglin
109320109320
margotmoinester
109321-
mari/
109321+
mari/
109322109322
maria
109323109323
maria-garytrainingsite
109324109324
maria_acevedo
@@ -113296,7 +113296,7 @@ mx/user
113296113296
mx/user$
113297113297
mx/your
113298113298
mx2019.jsp
113299-
mxf-final-cut-pro/
113299+
mxf-final-cut-pro/
113300113300
mxhe
113301113301
mxiao
113302113302
my
@@ -114450,7 +114450,7 @@ news-ga
114450114450
news-insider$
114451114451
news-israel-elections/elections-2015-undecided/
114452114452
news-law/crime/Article-d9f6b8163498f11004.htm
114453-
news-manager/
114453+
news-manager/
114454114454
news-marketing-collateral/press-releases/
114455114455
news-military/6361323ddea5a810/Article-db536baf3d10c81027.htm
114456114456
news-onair/actualites
@@ -135674,7 +135674,7 @@ salehizadeh
135674135674
salernolisa
135675135675
sales
135676135676
sales-demo-video/
135677-
sales-kit/
135677+
sales-kit/
135678135678
sales-leads
135679135679
sales/*?*after=
135680135680
sales/*?*before=
@@ -136209,7 +136209,7 @@ scr5net
136209136209
scrapertrap
136210136210
scratching
136211136211
screen
136212-
screen-flow/
136212+
screen-flow/
136213136213
screen-recorder-app?
136214136214
screen-time-strategies-you-can-start-today
136215136215
screen/image
@@ -136742,7 +136742,7 @@ search.py
136742136742
search.ref
136743136743
search.rl
136744136744
search/
136745-
search/
136745+
search/
136746136746
search/"
136747136747
search/$
136748136748
search/*
@@ -147168,7 +147168,7 @@ test.html
147168147168
test.jsp
147169147169
test.umb.edu/
147170147170
test/
147171-
test/
147171+
test/
147172147172
test/*
147173147173
test/*?question*
147174147174
test/*?rtf*
@@ -148525,7 +148525,7 @@ topla-kazan-kuponlari
148525148525
topo-summit-2019
148526148526
toprailapp
148527148527
tops
148528-
topsecret/
148528+
topsecret/
148529148529
topsfr
148530148530
topsocial
148531148531
topsy
@@ -148991,7 +148991,7 @@ tradeoffer
148991148991
traduction
148992148992
traffic
148993148993
traffic-aggregation
148994-
traffic-manager/
148994+
traffic-manager/
148995148995
traffic/status*?
148996148996
trafficbot.life
148997148997
trafficbot.live
@@ -150930,7 +150930,7 @@ upcomingeventdetails.html
150930150930
upcomingevents.html?
150931150931
update
150932150932
update-browser
150933-
update-check/wirecast/
150933+
update-check/wirecast/
150934150934
update-guide
150935150935
update-settings
150936150936
update-your-browser
@@ -152483,13 +152483,13 @@ vanity
152483152483
vannessajharrison
152484152484
vans/leasing/search
152485152485
vansorat
152486-
vantage-cloud/
152487-
vantage-enterprise/
152488-
vantage-transcoding/
152489-
vantageCloudManager/
152490-
vantageCloudTrial/
152491-
vantageDomainServer/
152492-
vantageTrancodeServer/
152486+
vantage-cloud/
152487+
vantage-enterprise/
152488+
vantage-transcoding/
152489+
vantageCloudManager/
152490+
vantageCloudTrial/
152491+
vantageDomainServer/
152492+
vantageTrancodeServer/
152493152493
vantage_point/archive
152494152494
vapors/
152495152495
var
@@ -152902,7 +152902,7 @@ video*search=*o=mr&page=8$
152902152902
video*search=*o=mr&page=9$
152903152903
video-
152904152904
video-alert
152905-
video-cue/
152905+
video-cue/
152906152906
video-en-directo
152907152907
video-gallery/
152908152908
video-keywords
@@ -178567,7 +178567,7 @@ wip/*
178567178567
wip_index.php
178568178568
wipostad/
178569178569
wire-
178570-
wire-cast/
178570+
wire-cast/
178571178571
wirecutter
178572178572
wirecutter/*&xid=
178573178573
wirecutter/*.csv$

0 commit comments

Comments
 (0)