Skip to content

Commit 028d4bc

Browse files
committed
feat: ai agent use case docs
1 parent 7bdb83a commit 028d4bc

File tree

4 files changed

+20
-1
lines changed

4 files changed

+20
-1
lines changed

sources/platform/integrations/workflows-and-notifications/n8n/ai-crawling.md

Lines changed: 20 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: N8N - AI crawling Actor integration
2+
title: n8n - AI crawling Actor integration
33
description: Learn about AI Crawling scraper modules.
44
sidebar_label: AI Crawling
55
sidebar_position: 6
@@ -163,3 +163,22 @@ In addition to the standard output fields, Advanced Settings provides:
163163

164164
You can access any of our 6,000+ scrapers on Apify Store by using the [general Apify app](https://n8n.io/integrations/apify).
165165

166+
## Usage as an AI Agent Tool
167+
168+
You can setup Apify's Website Content Crawler app as a tool for your AI Agents. Below is a very simple configuration for your agents.
169+
170+
![Setup AI Agent](./images/setup.png)
171+
172+
### Dynamic url crawling
173+
174+
In the Website Content Crawler module you can set the **Start URLs** to be filled in by your AI Agent dynamically as shown in the image below. This allows the Agent to decide on which pages to scrape off the internet.
175+
176+
We recommend using the **Advanced options** module with your AI Agent. Two key parameters in the Advanced module to set are **Max crawling depth** and **Max pages**. Remember that the scraping results are passed into the AI Agent’s context, so using smaller values for these parameters helps stay within context limits.
177+
178+
![Config Apify](./images/config.png)
179+
180+
### Example usage
181+
182+
Here I used it to find information about the latest blog post of Apify and its content. As you can see the AI Agent correctly filled the url for Apify's blog and summarized it's content
183+
184+
![Scraping Results](./images/result.png)
45.5 KB
Loading
445 KB
Loading
117 KB
Loading

0 commit comments

Comments
 (0)