You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Apify Scraper for AI Crawling from [Apify](https://console.apify.com/actors/aYG0l9s7dbB7j3gbS/input) lets you extract text content from websites to feed AI models, LLM applications, vector databases, or Retrieval Augmented Generation (RAG) pipelines. It supports rich formatting using Markdown, cleans the HTML of irrelevant elements, downloads linked files, and integrates with AI ecosystems like LangChain, LlamaIndex, and other LLM frameworks.
13
+
14
+
To use these modules, you need an [API token](https://docs.apify.com/platform/integrations/api#api-token). You can find your token in the [Apify Console](https://console.apify.com/) under **Settings > Integrations**. After connecting, you can automate content extraction at scale and incorporate the results into your AI workflows.
15
+
10
16
## Prerequisites
11
17
12
18
Before you begin, make sure you have:
13
19
14
20
- An [Apify account](https://console.apify.com/)
15
21
- An [n8n instance](https://docs.n8n.io/getting-started/) (self‑hosted or cloud)
16
22
17
-
## Apify Scraper for AI Crawling
18
-
19
-
Apify Scraper for AI Crawling from [Apify](https://apify.com/) lets you extract text content from websites to feed AI models, LLM applications, vector databases, or Retrieval Augmented Generation (RAG) pipelines. It supports rich formatting using Markdown, cleans the HTML of irrelevant elements, downloads linked files, and integrates with AI ecosystems like LangChain, LlamaIndex, and other LLM frameworks.
20
-
21
-
To use these modules, you need an [API token](https://docs.apify.com/platform/integrations/api#api-token). You can find your token in the [Apify Console](https://console.apify.com/) under **Settings > Integrations**. After connecting, you can automate content extraction at scale and incorporate the results into your AI workflows.
22
-
23
23
## Install the Apify Node (self-hosted)
24
24
25
25
If you're running a self-hosted n8n instance, you can install the Apify community node directly from the editor. This process adds the node to your available tools, enabling Apify operations in workflows.
@@ -33,6 +33,20 @@ If you're running a self-hosted n8n instance, you can install the Apify communit
33
33
34
34

35
35
36
+
## Install the Apify Scraper for AI Crawling Node (n8n Cloud)
37
+
38
+
For n8n Cloud users, installation is even simpler and doesn't require manual package entry. Just search and add the node from the canvas.
39
+
40
+
1. Go to the **Canvas** and open the **nodes panel**
41
+
1. Search for **Apify Scraper for AI Crawling** in the community node registry
42
+
1. Click **Install node** to add the Apify node to your instance
43
+
44
+
:::note Verified community nodes visibility
45
+
46
+
On n8n Cloud, instance owners can toggle visibility of verified community nodes in the Cloud Admin Panel. Ensure this setting is enabled to install the Apify Scraper for AI Crawling node.
47
+
48
+
:::
49
+
36
50
## Connect Apify Scraper for AI Crawling (self-hosted)
37
51
38
52
1. Create an account at [Apify](https://console.apify.com/). You can sign up using your email, Gmail, or GitHub account.
@@ -53,9 +67,24 @@ If you're running a self-hosted n8n instance, you can install the Apify communit
53
67
54
68

55
69
56
-
Once connected, you can build workflows to automate website extraction and integrate results into your AI applications.
70
+
### OAuth2 (cloud instance only)
71
+
72
+
1. In n8n Cloud, select **Create Credential**.
73
+
1. Search for Apify OAuth2 API and select **Continue**.
74
+
1. Select **Connect my account** and authorize with your Apify account.
75
+
1. n8n automatically retrieves and stores the OAuth2 tokens.
76
+
77
+

78
+
79
+
:::note
80
+
81
+
For simplicity on n8n Cloud, use the API key method if you prefer manual control over credentials.
82
+
83
+
:::
84
+
85
+
With authentication set up, you can now create workflows that incorporate the Apify node.
57
86
58
-
## Apify Scraper for Website Content modules
87
+
## Apify Scraper for AI Crawling modules
59
88
60
89
After connecting the app, you can use one of the two modules as native scrapers to extract website content.
61
90
@@ -136,7 +165,7 @@ You can access any of thousands of our scrapers on Apify Store by using the [gen
136
165
137
166
## Usage as an AI Agent Tool
138
167
139
-
You can setup Apify's Website Content Crawler app as a tool for your AI Agents.
168
+
You can setup Apify's Scraper for AI Crawling node as a tool for your AI Agents.
0 commit comments