You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+11-7Lines changed: 11 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -22,7 +22,7 @@ x-crawl is a flexible Node.js multifunctional crawler library. Flexible usage an
22
22
23
23
## Sponsor
24
24
25
-
x-crawl is an open source project under the MIT license, completely free to use. If you benefit from the projects I develop and maintain at work, please consider supporting my work through the [Afdian](https://afdian.net/a/coderhxl) platform.
25
+
x-crawl is an open source project licensed by MIT and is completely free to use. If you benefit from the projects I develop and maintain at work, so that I can continue to devote energy to the maintenance and update of the project and improve the user experience and functions, please consider using [Afdian](https://afdian.net/a/coderhxl) platform to support my work. Your support is the driving force for our continuous improvement! thank you for your support!
26
26
27
27
# Table of Contents
28
28
@@ -136,7 +136,7 @@ x-crawl is an open source project under the MIT license, completely free to use.
**Note:**Please do not crawl randomly, you can check the **robots.txt** protocol before crawling. The class name of the website may change, this is just to demonstrate how to use x-crawl.
206
+
**Note:**x-crawl is for legal purposes only. It is prohibited to use this tool for any illegal activities. Please be sure to comply with the robots.txt file regulations of the target website. The class name of the website may change at any time. This example is only used to demonstrate the use of x-crawl and is not specific to a specific website.
207
207
208
208
## Core Concepts
209
209
@@ -2106,16 +2106,20 @@ myXCrawl.crawlPage({
2106
2106
2107
2107
- **GitHub Discussions:** Use [GitHub Discussions](https://github.com/coder-hxl/x-crawl/discussions) for message board-style questions and discussions.
2108
2108
2109
-
Questions and discussions related to illegal activities may not be submitted. x-crawl is for legal use only. It is prohibited to use this tool to conduct any illegal activities, including but not limited to unauthorized data collection, cyber attacks, privacy invasion, etc.
2109
+
Questions and discussions related to any illegal activity may not be submitted. x-crawl is for legal purposes only, and it is prohibited to use this tool to conduct any illegal activities, including but not limited to unauthorized data collection, network attacks, privacy violations, etc. Please ensure that your usage behavior always complies with laws, regulations and ethical standards, and jointly maintain a safe and legal network environment.
2110
2110
2111
2111
### Issues
2112
2112
2113
2113
If you have questions, needs, or good suggestions, you can raise them at [GitHub Issues](https://github.com/coder-hxl/x-crawl/issues).
2114
2114
2115
2115
### Sponsor
2116
2116
2117
-
x-crawl is an open source project under the MIT license, completely free to use. If you benefit from the projects I develop and maintain at work, please consider supporting my work through the [Afdian](https://afdian.net/a/coderhxl) platform.
2117
+
x-crawl is an open source project licensed by MIT and is completely free to use. If you benefit from the projects I develop and maintain at work, so that I can continue to devote energy to the maintenance and update of the project and improve the user experience and functions, please consider using [Afdian](https://afdian.net/a/coderhxl) platform to support my work. Your support is the driving force for our continuous improvement! thank you for your support!
2118
2118
2119
-
### Special Instructions
2119
+
### Precautions
2120
2120
2121
-
x-crawl is for legal use only. It is prohibited to use this tool to conduct any illegal activities, including but not limited to unauthorized data collection, cyber attacks, privacy invasion, etc.
2121
+
- x-crawl is for legal purposes only. It is prohibited to use this tool to conduct any illegal activities, including but not limited to unauthorized data collection, network attacks, privacy violations, etc.
2122
+
- Before collecting data, make sure you have explicit authorization from the target website and comply with its robots.txt file and terms of use.
2123
+
- Avoid placing excessive access pressure on the target website to avoid triggering its anti-crawling strategy or causing server downtime.
2124
+
2125
+
**x-crawl is for legal purposes only, x-crawl does not bear any responsibility for any legal liability arising from the use of x-crawl**
0 commit comments