Skip to content

Commit 1f12055

Browse files
author
jdv
committed
Bot and scrapper section done
1 parent 8bca7d0 commit 1f12055

File tree

1 file changed

+25
-24
lines changed

1 file changed

+25
-24
lines changed

crowdsec-docs/unversioned/troubleshooting/usecases.mdx

Lines changed: 25 additions & 24 deletions
Original file line numberDiff line numberDiff line change
@@ -107,47 +107,48 @@ Quickly choose among qualified malicious actors regrouped by industry, behaviors
107107

108108
---
109109

110-
## Web Application Protection
110+
## Bot and Scraper Management
111111

112-
Quickly protect web applications from the latest CVEs and generic vulnerability exploits using CrowdSec WAF.
112+
Control aggressive crawlers and scraping tools while preserving legitimate user access using graduated response strategies.
113113

114114
**Is it for me?**
115-
Ideal if you want a modern OpenSource WAF solution.
116-
Benefit from CrowdSec's Virtual patching catalog while being able to use your existing ModSecurity rules as is.
115+
Ideal if you're dealing with aggressive bots or scrapers that impact your site performance.
116+
Good option if you want to prevent illegitimate AI crawlers from visiting your site.
117117

118118
**How it works:**
119-
- Deploy CrowdSec Security Engine with AppSec module on your reverse proxy or web server.
120-
- Get CrowdSec Virtual patching collection.
121-
- Easily scale and identify behaviors accross multiple servers over time.
122-
- Go further by using your existing appsec rules.
123-
- Even test CRS rules out of band on your production traffic to easily adapt them to you needs.
124-
119+
- Retrieve AI Crawlers and/or Botnets IPs from CrowdSec Blocklist integrations
120+
- Block at the edge using your firewall or CDN.
125121

126122
**References**
127-
- ...
123+
- [Blocking at the edge section](#blocking-at-the-edge)
124+
- [Custom scenario creation](/docs/next/scenarios/create)
125+
- [AI Crawlers Blocklist ↗️](https://app.crowdsec.net/blocklists/67b3524151bbde7a12b60be0)
126+
- [Currated Botnet Actors ↗️](https://app.crowdsec.net/blocklists/65a56c160469607d9badb813)
127+
- [Public Internet Scanners ↗️](https://app.crowdsec.net/blocklists/65f972eb807e06de7a0e3e65)
128128

129129
---
130130

131-
## Bot and Scraper Management
131+
## Block Common web attacks fast
132132

133-
Control aggressive crawlers and scraping tools while preserving legitimate user access using graduated response strategies.
133+
Quickly protect web applications from the latest CVEs and generic vulnerability exploits using CrowdSec WAF.
134134

135135
**Is it for me?**
136-
Ideal if you're dealing with aggressive bots or scrapers that impact your site performance.
137-
Good option if you need granular control over automated traffic without blocking legitimate users or search engines.
136+
Ideal if you want a modern OpenSource WAF solution.
137+
Benefit from CrowdSec's Virtual patching catalog while being able to use your existing ModSecurity rules as is.
138138

139139
**How it works:**
140-
- Configure behavioral detection scenarios to identify suspicious crawling patterns.
141-
- Implement graduated responses starting with throttling, escalating to temporary bans.
142-
- Use specialized AI Crawlers Blocklist to block known malicious crawling IPs.
143-
- Deploy edge blocking through firewall or CDN integration for immediate protection.
140+
- Deploy CrowdSec Security Engine with AppSec module on your reverse proxy or web server.
141+
- Get CrowdSec Virtual patching collection.
142+
- Easily scale and identify behaviors accross multiple servers over time.
143+
- Go further by using your existing appsec rules.
144+
- Even test CRS rules out of band on your production traffic to easily adapt them to you needs.
145+
144146

145147
**References**
146-
- [Import throttle decisions](/docs/next/cscli/cscli_decisions_import)
147-
- [Custom scenario creation](/docs/next/scenarios/create)
148-
- [AI Crawlers Blocklist subscription](/u/console/blocklists/subscription/)
149-
- [Edge integration options](/u/integrations/intro)
150-
- [Behavioral detection configuration](/docs/next/scenarios/introduction)
148+
- [Security Engine installation](/u/getting_started/intro)
149+
- [CrowdSec WAF presentation](/appsec/intro)
150+
- [Virtual Patching collection ↗️](https://app.crowdsec.net/hub/author/crowdsecurity/collections/appsec-virtual-patching)
151+
- [CrowdSec WAF article ↗️](https://www.crowdsec.net/blog/crowdsec-waf-the-collaborative-future-of-web-application-security)
151152

152153
---
153154

0 commit comments

Comments
 (0)