docs: describe the AI assisted crawler

Author: coder-hxl

README.md

@@ -26,6 +26,16 @@ It consists of two parts:
 - **🧾 Crawl information** - Controllable crawl information, which will output colored string information in the terminal.
 - **🦾 TypeScript** - Own types and implement complete types through generics.
 
+## AI assisted crawler
+
+With the rapid development of network technology, website updates have become more frequent, and changes in class names or structures often bring considerable challenges to crawlers that rely on these elements. Against this background, crawlers combined with AI technology have become a powerful weapon to meet this challenge.
+
+First of all, changes in class names or structures after website updates may cause traditional crawler strategies to fail. This is because crawlers often rely on fixed class names or structures to locate and extract the required information. Once these elements change, the crawler may not be able to accurately find the required data, thus affecting the effectiveness and accuracy of data crawling.
+
+However, crawlers combined with AI technology are better able to cope with this change. AI can also understand and parse the semantic information of web pages through natural language processing and other technologies to more accurately extract the required data.
+
+To sum up, crawlers combined with AI technology can better cope with the problem of class name or structure changes after website updates.
+
 ## Example
 
 The combination of crawler and AI allows the crawler and AI to obtain pictures of high-rated vacation rentals according to our instructions:
@@ -70,6 +80,8 @@ crawlApp.crawlPage('https://www.airbnb.cn/s/select_homes').then(async (res) => {
 })
 ```
 
+**You can even pass the entire HTML to AI to help us operate it. Since the website content is more complex, you also need to describe the location to be taken more accurately. The most important thing is that it will consume more Tokens.**
+
 Pictures of highly rated vacation rentals climbed to:
 
 ![](https://raw.githubusercontent.com/coder-hxl/x-crawl/main/assets/example.png)

docs/about/issues.md

@@ -1,3 +1,3 @@
-#Issues
+# Issues
 
 If you have **questions, requirements, and good suggestions**, you can raise **Issues** in [GitHub Issues](https://github.com/coder-hxl/x-crawl/issues).

docs/api/custom.md

@@ -1,4 +1,4 @@
-#custom
+# custom
 
 custom is a method of AI application instance, usually used for user-defined AI functions.
 

docs/api/parse-elements.md

@@ -1,4 +1,4 @@
-#parseElements
+# parseElements
 
 parseElements is a method of AI application instances, typically used for intelligent on-demand analysis of elements.
 

docs/cn/guide/index.md

@@ -26,6 +26,16 @@ x-crawl 是一个灵活的 Node.js AI 辅助爬虫库。灵活的使用方式和
 - **🧾 爬取信息** - 可控的爬取信息，会在终端输出彩色字符串信息。
 - **🦾 TypeScript** - 拥有类型，通过泛型实现完整的类型。
 
+## AI 辅助爬虫
+
+随着网络技术的日新月异，网站更新变得愈发频繁，而类名或结构的改变往往给依赖这些元素的爬虫带来不小的挑战。在这样的背景下，结合 AI 技术的爬虫成为了应对这一挑战的有力武器。
+
+首先，网站更新后类名或结构的改变可能导致传统的爬虫抓取策略失效。这是因为爬虫通常依赖于固定的类名或结构来定位并提取所需信息。一旦这些元素发生变化，爬虫就可能无法准确找到所需数据，从而影响数据抓取的效果和准确性。
+
+然而，结合 AI 技术的爬虫则能够更好地应对这种变化。AI 还可以通过自然语言处理等技术，理解并解析网页的语义信息，从而更准确地提取所需数据。
+
+综上所述，结合 AI 技术的爬虫能够更好地应对网站更新后类名或结构改变的问题。
+
 ## 示例
 
 爬虫和 AI 结合，让爬虫和 AI 根据我们的指令获取高评分度假屋的图片：
@@ -70,6 +80,10 @@ crawlApp.crawlPage('https://www.airbnb.cn/s/select_homes').then(async (res) => {
 })
 ```
 
+::: tip
+你甚至可以将整个 HTML 传给 AI 帮我们操作，由于网站内容更加复杂你还需要更准确描述要取的位置，最重要的是会消耗更多 Tokens 。
+:::
+
 爬到的高评分度假屋图片:
 
 ![](/example.png)

docs/guide/index.md

@@ -26,6 +26,16 @@ It consists of two parts:
 - **🧾 Crawl information** - Controllable crawl information, which will output colored string information in the terminal.
 - **🦾 TypeScript** - Own types and implement complete types through generics.
 
+## AI assisted crawler
+
+With the rapid development of network technology, website updates have become more frequent, and changes in class names or structures often bring considerable challenges to crawlers that rely on these elements. Against this background, crawlers combined with AI technology have become a powerful weapon to meet this challenge.
+
+First of all, changes in class names or structures after website updates may cause traditional crawler strategies to fail. This is because crawlers often rely on fixed class names or structures to locate and extract the required information. Once these elements change, the crawler may not be able to accurately find the required data, thus affecting the effectiveness and accuracy of data crawling.
+
+However, crawlers combined with AI technology are better able to cope with this change. AI can also understand and parse the semantic information of web pages through natural language processing and other technologies to more accurately extract the required data.
+
+To sum up, crawlers combined with AI technology can better cope with the problem of class name or structure changes after website updates.
+
 ## Example
 
 The combination of crawler and AI allows the crawler and AI to obtain pictures of high-rated vacation rentals according to our instructions:
@@ -70,6 +80,10 @@ crawlApp.crawlPage('https://www.airbnb.cn/s/select_homes').then(async (res) => {
 })
 ```
 
+::: tip
+You can even pass the entire HTML to AI to help us operate it. Since the website content is more complex, you also need to describe the location to be taken more accurately. The most important thing is that it will consume more Tokens.
+:::
+
 Pictures of highly rated vacation rentals climbed to:
 
 ![](/example.png)