Skip to content

swimmingkiim/n8n-nodes-crawl-and-scrape

Repository files navigation

n8n-nodes-crawl-and-scrape

This is an n8n community node. It lets you use crawl and scrape websites in your n8n workflows.

I used crawlee for this project. Crawlee is a powerful web scraping and crawling library that helps you extract data from websites efficiently and reliably.

n8n is a fair-code licensed workflow automation platform.

Installation
Operations
Credentials
Compatibility
Resources
Version history

Installation

Follow the installation guide in the n8n community nodes documentation.

Operations

The node supports the following operations:

  • Extract Links: Crawls a website and extracts all links found on the page
  • Extract Text: Extracts all text content from a webpage
  • Extract HTML: Retrieves the raw HTML content of a webpage

Credentials

No credentials are required to use this node.

Compatibility

This node is compatible with n8n version 1.0.0 and above.

Resources

Version history

See CHANGELOG.md for details.

About

n8n custom node to crawl and scrape website with crawlee

Topics

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors