diff --git a/sources/platform/integrations/workflows-and-notifications/make/ai-crawling.md b/sources/platform/integrations/workflows-and-notifications/make/ai-crawling.md new file mode 100644 index 0000000000..2af82d2dc9 --- /dev/null +++ b/sources/platform/integrations/workflows-and-notifications/make/ai-crawling.md @@ -0,0 +1,153 @@ +--- +title: Make - AI crawling Actor integration +description: Learn about AI Crawling scraper modules. +sidebar_label: AI Crawling +sidebar_position: 6 +slug: /integrations/make/ai-crawling +toc_max_heading_level: 4 +--- + +## Apify Scraper for AI Crawling + +Apify Scraper for AI Crawling from [Apify](https://apify.com/) lets you extract text content from websites to feed AI models, LLM applications, vector databases, or Retrieval Augmented Generation(RAG) pipelines. It supports rich formatting using Markdown, cleans the HTML of irrelevant elements, downloads linked files, and integrates with AI ecosystems like LangChain, LlamaIndex, and other LLM frameworks. + +To use these modules, you need an [Apify account](https://console.apify.com) and an [API token](https://docs.apify.com/platform/integrations/api#api-token). You can find your token in the [Apify Console](https://console.apify.com/) under **Settings > Integrations**. After connecting, you can automate content extraction at scale and incorporate the results into your AI workflows. + +## Connect Apify Scraper for AI Crawling + +1. Create an account at [Apify](https://console.apify.com/). You can sign up using your email, Gmail, or GitHub account. + + ![Sign up page](images/ai-crawling/wcc-signup.png) + +1. To connect your Apify account to Make, you can use an OAuth connection (recommended) or an Apify API token. To get the Apify API token, navigate to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)** in the Apify Console. + + ![Apify Console token for Make.png](images/Apify_Console_token_for_Make.png) + +1. Find your token under **Personal API tokens** section. You can also create a new API token with multiple customizable permissions by clicking on **+ Create a new token**. +1. Click the **Copy** icon next to your API token to copy it to your clipboard. Then, return to your Make scenario interface. + + ![Apify token on Make.png](images/Apify_token_on_Make.png) + +1. In Make, click **Add** to open the **Create a connection** dialog of the chosen Apify Scraper module. +1. In the **API token** field, paste the API token you copied from Apify. Provide a clear **Connection name**, and click **Save**. + + ![Make API token](images/ai-crawling/image%201.png) + +Once connected, you can build workflows to automate website extraction and integrate results into your AI applications. + +## Apify Scraper for Website Content modules + +After connecting the app, you can use one of the two modules as native scrapers to extract website content. + +### Standard Settings Module + +The Standard Settings module is a streamlined component of the Website Content Crawler that allows you to quickly extract content from websites using optimized default settings. This module is perfect for extracting content from blogs, documentation sites, knowledge bases, or any text-rich website to feed into AI models. + +#### How it works + +The crawler starts with one or more **Start URLs** you provide, typically the top-level URL of a documentation site, blog, or knowledge base. It then: + +- Crawls these start URLs +- Finds links to other pages on the site +- Recursively crawls those pages as long as their URL is under the start URL +- Respects URL patterns for inclusion/exclusion +- Automatically skips duplicate pages with the same canonical URL +- Provides various settings to customize crawling behavior (crawler type, max pages, depth, concurrency, etc.) + +Once a web page is loaded, the Actor processes its HTML to ensure quality content extraction: + +- Waits for dynamic content to load if using a headless browser +- Can scroll to a certain height to ensure all page content is loaded +- Can expand clickable elements to reveal hidden content +- Removes DOM nodes matching specific CSS selectors (like navigation, headers, footers) +- Optionally keeps only content matching specific CSS selectors +- Removes cookie warnings using browser extensions +- Transforms the page using the selected HTML transformer to extract the main content + +#### Output data + +For each crawled web page, you'll receive: + +- _Page metadata_: URL, title, description, canonical URL +- _Cleaned text content_: The main article content with irrelevant elements removed +- _Markdown formatting_: Structured content with headers, lists, links, and other formatting preserved +- _Crawl information_: Loaded URL, referrer URL, timestamp, HTTP status +- _Optional file downloads_: PDFs, DOCs, and other linked documents + +```json title="Sample output (shortened)" +{ + "url": "https://docs.apify.com/academy/web-scraping-for-beginners", + "crawl": { + "loadedUrl": "https://docs.apify.com/academy/web-scraping-for-beginners", + "loadedTime": "2025-04-22T14:33:20.514Z", + "referrerUrl": "https://docs.apify.com/academy", + "depth": 1, + "httpStatusCode": 200 + }, + "metadata": { + "canonicalUrl": "https://docs.apify.com/academy/web-scraping-for-beginners", + "title": "Web scraping for beginners | Apify Documentation", + "description": "Learn the basics of web scraping with a step-by-step tutorial and practical exercises.", + "languageCode": "en", + "markdown": "# Web scraping for beginners\n\nWelcome to our comprehensive web scraping tutorial for beginners. This guide will take you through the fundamentals of extracting data from websites, with practical examples and exercises.\n\n## What is web scraping?\n\nWeb scraping is the process of extracting data from websites. It involves making HTTP requests to web servers, downloading HTML pages, and parsing them to extract the desired information.\n\n## Why learn web scraping?\n\n- **Data collection**: Gather information for research, analysis, or business intelligence\n- **Automation**: Save time by automating repetitive data collection tasks\n- **Integration**: Connect web data with your applications or databases\n- **Monitoring**: Track changes on websites automatically\n\n## Getting started\n\nTo begin web scraping, you'll need to understand the basics of HTML, CSS selectors, and HTTP. This tutorial will guide you through these concepts step by step.\n\n...", + "text": "Web scraping for beginners\n\nWelcome to our comprehensive web scraping tutorial for beginners. This guide will take you through the fundamentals of extracting data from websites, with practical examples and exercises.\n\nWhat is web scraping?\n\nWeb scraping is the process of extracting data from websites. It involves making HTTP requests to web servers, downloading HTML pages, and parsing them to extract the desired information.\n\nWhy learn web scraping?\n\n- Data collection: Gather information for research, analysis, or business intelligence\n- Automation: Save time by automating repetitive data collection tasks\n- Integration: Connect web data with your applications or databases\n- Monitoring: Track changes on websites automatically\n\nGetting started\n\nTo begin web scraping, you'll need to understand the basics of HTML, CSS selectors, and HTTP. This tutorial will guide you through these concepts step by step.\n\n..." + } +} +``` + +### Advanced Settings Module + +The Advanced Settings module provides complete control over the content extraction process, allowing you to fine-tune every aspect of the crawling and transformation pipeline. This module is ideal for complex websites, JavaScript-heavy applications, or when you need precise control over content extraction. + +#### Key features + +- _Multiple Crawler Options_: Choose between headless browsers (Playwright) or faster HTTP clients (Cheerio) +- _Custom Content Selection_: Specify exactly which elements to keep or remove +- _Advanced Navigation Control_: Set crawling depth, scope, and URL patterns +- _Dynamic Content Handling_: Wait for JavaScript-rendered content to load +- _Interactive Element Support_: Click expandable sections to reveal hidden content +- _Multiple Output Formats_: Save content as Markdown, HTML, or plain text +- _Proxy Configuration_: Use proxies to handle geo-restrictions or avoid IP blocks +- _Content Transformation Options_: Multiple algorithms for optimal content extraction + +#### How it works + +The Advanced Settings module provides granular control over the entire crawling process: + +1. _Crawler Selection_: Choose from Playwright (Firefox/Chrome), or Cheerio based on website complexity +2. _URL Management_: Define precise scoping with include/exclude URL patterns +3. _DOM Manipulation_: Control which HTML elements to keep or remove +4. _Content Transformation_: Apply specialized algorithms for content extraction +5. _Output Formatting_: Select from multiple formats for AI model compatibility + +#### Configuration options + +Advanced Settings offers numerous configuration options, including: + +- _Crawler Type_: Select the rendering engine (browser or HTTP client) +- _Content Extraction Algorithm_: Choose from multiple HTML transformers +- _Element Selectors_: Specify which elements to keep, remove, or click +- _URL Patterns_: Define URL inclusion/exclusion patterns with glob syntax +- _Crawling Parameters_: Set concurrency, depth, timeouts, and retries +- _Proxy Configuration_: Configure proxy settings for robust crawling +- _Output Options_: Select content formats and storage options + +#### Output data + +In addition to the standard output fields, Advanced Settings provides: + +- _Multiple Format Options_: Content in Markdown, HTML, or plain text +- _Debug Information_: Detailed extraction diagnostics and snapshots +- _HTML Transformations_: Results from different content extraction algorithms +- _File Storage Options_: Flexible storage for HTML, screenshots, or downloaded files + +Looking for more than just AI crawling? You can use other native Make apps powered by Apify: + +- [Instagram Data](/platform/integrations/make/instagram) +- [TikTok Data](/platform/integrations/make/tiktok) +- [Google Search](/platform/integrations/make/search) +- [Google Maps Emails Data](/platform/integrations/make/maps) +- [YouTube Data](/platform/integrations/make/youtube) +- [Amazon](/platform/integrations/make/amazon) + +And more! Because you can access any of our 4,500+ scrapers on Apify Store by using the [general Apify connections](https://www.make.com/en/integrations/apify). diff --git a/sources/platform/integrations/workflows-and-notifications/make/amazon.md b/sources/platform/integrations/workflows-and-notifications/make/amazon.md new file mode 100644 index 0000000000..59803a2ed0 --- /dev/null +++ b/sources/platform/integrations/workflows-and-notifications/make/amazon.md @@ -0,0 +1,237 @@ +--- +title: Make - Amazon Actor integration +description: Learn about Amazon scraper modules, extract product, search, or category data from Amazon. +sidebar_label: Amazon +sidebar_position: 6 +slug: /integrations/make/amazon +--- + +## Apify Scraper for Amazon Data + +The Amazon Scraper module from [Apify](https://apify.com) allows you to extract product, search, or category data from Amazon. + +To use the module, you need an [Apify account](https://console.apify.com) and an [API token](https://docs.apify.com/platform/integrations/api#api-token), which you can find in the Apify Console under **Settings > Integrations**. After connecting, you can automate data extraction and incorporate the results into your workflows. + +## Connect Apify Scraper for Amazon Data modules to Make + +1. Create an account at [Apify](https://console.apify.com/). You can sign up using your email, Gmail, or GitHub account. + + ![Sign up page](images/amazon/image.png) + +1. To connect your Apify account to Make, you can use an OAuth connection (recommended) or an Apify API token. To get the Apify API token, navigate to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)** in the Apify Console. + + ![Apify Console token for Make.png](images/Apify_Console_token_for_Make.png) + +1. Find your token under **Personal API tokens** section. You can also create a new API token with multiple customizable permissions by clicking on **+ Create a new token**. +1. Click the **Copy** icon next to your API token to copy it to your clipboard. Then, return to your Make scenario interface. + + ![Apify token on Make.png](images/Apify_token_on_Make.png) + +1. In Make, click **Add** to open the **Create a connection** dialog of the chosen Apify Scraper module. +1. In the **API token** field, paste the API token you copied from Apify. Provide a clear **Connection name**, and click **Save**. + + ![Make API token](images/amazon/image1.png) + +Once connected, you can build workflows to automate Amazon data extraction and integrate results into your applications. + +## Apify Scraper for Amazon Data module + +After connecting the app, you can use the Search module as a native scraper to extract public Amazon data. Here’s what you get: + +### Extract Amazon data + +Get data via [Apify's Amazon Scraper](https://apify.com/junglee/free-amazon-product-scraper). Fill in the URLs of products, searches, or categories you want to gather information about. + +For Amazon URLs, you can extract: + +- _Product title_ +- _Amazon ASIN number_ +- _Brand name_ +- _Number of reviews_ +- _Image_ +- _Description_ +- _Price value and currency_ + +```json title="Example" +[ + { + "title": "Logitech M185 Wireless Mouse, 2.4GHz with USB Mini Receiver, 12-Month Battery Life, 1000 DPI Optical Tracking, Ambidextrous PC/Mac/Laptop - Swift Grey", + "asin": "B004YAVF8I", + "brand": "Logitech", + "stars": 4.5, + "reviewsCount": 37418, + "thumbnailImage": "https://m.media-amazon.com/images/I/5181UFuvoBL.__AC_SX300_SY300_QL70_FMwebp_.jpg", + "breadCrumbs": "Electronics›Computers & Accessories›Computer Accessories & Peripherals›Keyboards, Mice & Accessories›Mice", + "description": "Logitech Wireless Mouse M185. A simple, reliable mouse with plug-and-play wireless, a 1-year battery life and 3-year limited hardware warranty.(Battery life may vary based on user and computing conditions.) System Requirements: Windows Vista Windows 7 Windows 8 Windows 10|Mac OS X 10.5 or later|Chrome OS|Linux kernel 2.6+|USB port", + "price": { + "value": 13.97, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B004YAVF8I" + }, + { + "title": "Logitech MX Master 3S - Wireless Performance Mouse with Ultra-fast Scrolling, Ergo, 8K DPI, Track on Glass, Quiet Clicks, USB-C, Bluetooth, Windows, Linux, Chrome - Graphite", + "asin": "B09HM94VDS", + "brand": "Logitech", + "stars": 4.5, + "reviewsCount": 9333, + "thumbnailImage": "https://m.media-amazon.com/images/I/41+eEANAv3L._AC_SY300_SX300_.jpg", + "breadCrumbs": "Electronics›Computers & Accessories›Computer Accessories & Peripherals›Keyboards, Mice & Accessories›Mice", + "description": "Logitech MX Master 3S Performance Wireless Mouse Introducing Logitech MX Master 3S – an iconic mouse remastered. Now with Quiet Clicks(2) and 8K DPI any-surface tracking for more feel and performance than ever before. Product details: Weight: 4.97 oz (141 g) Dimensions: 2 x 3.3 x 4.9 in (51 x 84.3 x 124.9 mm) Compatible with Windows, macOS, Linux, Chrome OS, iPadOS, Android operating systems (8) Rechargeable Li-Po (500 mAh) battery Sensor technology: Darkfield high precision Buttons: 7 buttons (Left/Right-click, Back/Forward, App-Switch, Wheel mode-shift, Middle click), Scroll Wheel, Thumbwheel, Gesture button Wireless operating distance: 33 ft (10 m) (9)Footnotes: (1) 4 mm minimum glass thickness (2) Compared to MX Master 3, MX Master 3S has 90% less Sound Power Level left and right click, measured at 1m (3) Compared to regular Logitech mouse without an electromagnetic scroll wheel (4) Compared to Logitech Master 2S mouse with Logitech Options installed and Smooth scrolling enabled (5) Requires Logi Options+ software, available for Windows and macOS (6) Not compatible with Logitech Unifying technology (7) Battery life may vary based on user and computing conditions. (8) Device basic functions will be supported without software for operating systems other than Windows and macOS (9) Wireless range may vary depending on operating environment and computer setup", + "price": { + "value": 89.99, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B09HM94VDS" + }, + { + "title": "Apple Magic Mouse - White Multi-Touch Surface ", + "asin": "B0DL72PK1P", + "brand": "Apple", + "stars": 4.6, + "reviewsCount": 18594, + "thumbnailImage": "", + "breadCrumbs": "", + "description": null, + "price": { + "value": 78.99, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B0DL72PK1P" + } +] +``` + +```json title="Search data sample" +[ + { + "title": "Logitech MK270 Wireless Keyboard And Mouse Combo For Windows, 2.4 GHz Wireless, Compact Mouse, 8 Multimedia And Shortcut Keys, For PC, Laptop - Black", + "asin": "B079JLY5M5", + "brand": "Logitech", + "stars": 4.5, + "reviewsCount": 107637, + "thumbnailImage": "https://m.media-amazon.com/images/I/61gSpxZTZZL.__AC_SX300_SY300_QL70_ML2_.jpg", + "breadCrumbs": "Electronics›Computers & Accessories›Computer Accessories & Peripherals›Keyboards, Mice & Accessories›Keyboard & Mouse Combos", + "description": "The stylish Logitech MK270 Wireless Keyboard and Mouse Combo is perfect for the home office or workplace. Ditch the touchpad for this full size keyboard and mouse. Easily connect using Logitech's plug and forget receiver—just plug it into the USB port, and you're ready to work. There's no lengthy installation procedure to slow you down. When you're on the move, the receiver stores comfortably inside the mouse. Both the keyboard and mouse included in the MK270 combo use wireless 2.4GHz connectivity to provide seamless, interruption free use. Use the keyboard within a 10 m range without keyboard lag. Work for longer with the MK270's long battery life. The keyboard can be used for up to 24 months, and the mouse for 12 months, without replacing batteries. The Logitech MK270 keyboard includes 8 hotkeys that are programmable to your most used applications to boost your productivity.", + "price": { + "value": 21.98, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B079JLY5M5" + }, + { + "title": "Wireless Keyboard and Mouse Combo - Round Keycaps, Full-Size Retro Typewriter Keyboard with Detachable Wrist Rest, Sleep Mode & Tilt Legs, 2.4GHz Cordless Connection for Mac/Windows/PC (Hot Pink)", + "asin": "B0CQJV4BW3", + "brand": "SABLUTE", + "stars": 4.3, + "reviewsCount": 928, + "thumbnailImage": "https://m.media-amazon.com/images/I/61NOammUF2L.__AC_SY300_SX300_QL70_FMwebp_.jpg", + "breadCrumbs": "Electronics›Computers & Accessories›Computer Accessories & Peripherals›Keyboards, Mice & Accessories›Keyboard & Mouse Combos", + "description": null, + "price": { + "value": 39.99, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B0CQJV4BW3" + }, + { + "title": "Redragon S101 Gaming Keyboard, M601 Mouse, RGB Backlit Gaming Keyboard, Programmable Backlit Gaming Mouse, Value Combo Set [New Version]", + "asin": "B00NLZUM36", + "brand": "Redragon", + "stars": 4.6, + "reviewsCount": 46346, + "thumbnailImage": "https://m.media-amazon.com/images/I/71QDJHG1PqL.__AC_SX300_SY300_QL70_FMwebp_.jpg", + "breadCrumbs": "Video Games›PC›Accessories›Gaming Keyboards", + "description": null, + "price": { + "value": 39.99, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B00NLZUM36" + } +] +``` + +```json title="Product data sample" +[ + { + "title": "Amazon Basics Wired Keyboard, Full-Sized, QWERTY Layout, Black", + "asin": "B07WJ5D3H4", + "brand": "Amazon Basics", + "stars": 4.5, + "reviewsCount": 7606, + "thumbnailImage": "https://m.media-amazon.com/images/I/71ehwfAM4-L.__AC_SY300_SX300_QL70_FMwebp_.jpg", + "breadCrumbs": "Electronics›Computers & Accessories›Computer Accessories & Peripherals›Keyboards, Mice & Accessories›Keyboards", + "description": "Product DescriptionFeaturing a standard US QWERTY layout, the keyboard provides comfort and familiarity, while the sleek black design complements any tech setup or decor seamlessly. This wired keyboard and mouse set is great for those seeking a wired keyboard and mouse for home or office use. The mouse and keyboard combo offers a practical plug-and-play solution, compatible with multiple versions of Windows, including 2000, XP, Vista, 7, 8, and 10/11.From the ManufacturerAmazon Basics", + "price": { + "value": 18.04, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B07WJ5D3H4" + } +] +``` + +```json title="Category data sample" +[ + { + "title": "Logitech M185 Wireless Mouse, 2.4GHz with USB Mini Receiver, 12-Month Battery Life, 1000 DPI Optical Tracking, Ambidextrous PC/Mac/Laptop - Swift Grey", + "asin": "B004YAVF8I", + "brand": "Logitech", + "stars": 4.5, + "reviewsCount": 37418, + "thumbnailImage": "https://m.media-amazon.com/images/I/5181UFuvoBL.__AC_SX300_SY300_QL70_FMwebp_.jpg", + "breadCrumbs": "Electronics›Computers & Accessories›Computer Accessories & Peripherals›Keyboards, Mice & Accessories›Mice", + "description": "Logitech Wireless Mouse M185. A simple, reliable mouse with plug-and-play wireless, a 1-year battery life and 3-year limited hardware warranty.(Battery life may vary based on user and computing conditions.) System Requirements: Windows Vista Windows 7 Windows 8 Windows 10|Mac OS X 10.5 or later|Chrome OS|Linux kernel 2.6+|USB port", + "price": { + "value": 13.97, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B004YAVF8I" + }, + { + "title": "Logitech MX Master 3S - Wireless Performance Mouse with Ultra-fast Scrolling, Ergo, 8K DPI, Track on Glass, Quiet Clicks, USB-C, Bluetooth, Windows, Linux, Chrome - Graphite", + "asin": "B09HM94VDS", + "brand": "Logitech", + "stars": 4.5, + "reviewsCount": 9333, + "thumbnailImage": "https://m.media-amazon.com/images/I/41+eEANAv3L._AC_SY300_SX300_.jpg", + "breadCrumbs": "Electronics›Computers & Accessories›Computer Accessories & Peripherals›Keyboards, Mice & Accessories›Mice", + "description": "Logitech MX Master 3S Performance Wireless Mouse Introducing Logitech MX Master 3S – an iconic mouse remastered. Now with Quiet Clicks(2) and 8K DPI any-surface tracking for more feel and performance than ever before. Product details: Weight: 4.97 oz (141 g) Dimensions: 2 x 3.3 x 4.9 in (51 x 84.3 x 124.9 mm) Compatible with Windows, macOS, Linux, Chrome OS, iPadOS, Android operating systems (8) Rechargeable Li-Po (500 mAh) battery Sensor technology: Darkfield high precision Buttons: 7 buttons (Left/Right-click, Back/Forward, App-Switch, Wheel mode-shift, Middle click), Scroll Wheel, Thumbwheel, Gesture button Wireless operating distance: 33 ft (10 m) (9)Footnotes: (1) 4 mm minimum glass thickness (2) Compared to MX Master 3, MX Master 3S has 90% less Sound Power Level left and right click, measured at 1m (3) Compared to regular Logitech mouse without an electromagnetic scroll wheel (4) Compared to Logitech Master 2S mouse with Logitech Options installed and Smooth scrolling enabled (5) Requires Logi Options+ software, available for Windows and macOS (6) Not compatible with Logitech Unifying technology (7) Battery life may vary based on user and computing conditions. (8) Device basic functions will be supported without software for operating systems other than Windows and macOS (9) Wireless range may vary depending on operating environment and computer setup", + "price": { + "value": 89.99, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B09HM94VDS" + }, + { + "title": "Apple Magic Mouse - White Multi-Touch Surface ", + "asin": "B0DL72PK1P", + "brand": "Apple", + "stars": 4.6, + "reviewsCount": 18594, + "thumbnailImage": "https://m.media-amazon.com/images/I/41U6Q0T5toL.__AC_SY445_SX342_QL70_FMwebp_.jpg", + "breadCrumbs": "", + "description": null, + "price": { + "value": 78.99, + "currency": "$" + }, + "url": "https://www.amazon.com/dp/B0DL72PK1P" + } +] +``` + +## Other scrapers available + +There are other native Make Apps powered by Apify. You can check out Apify Scraper for: + +- [Instagram Data](/platform/integrations/make/instagram) +- [TikTok Data](/platform/integrations/make/tiktok) +- [Google Search](/platform/integrations/make/search) +- [Google Maps Emails Data](/platform/integrations/make/maps) +- [YouTube Data](/platform/integrations/make/youtube) +- [AI crawling](/platform/integrations/make/ai-crawling) + + +And more! Because you can access any of our 4,500+ scrapers on Apify Store by using the [general Apify connections](https://www.make.com/en/integrations/apify). diff --git a/sources/platform/integrations/workflows-and-notifications/make/facebook.md b/sources/platform/integrations/workflows-and-notifications/make/facebook.md new file mode 100644 index 0000000000..ac94c4d140 --- /dev/null +++ b/sources/platform/integrations/workflows-and-notifications/make/facebook.md @@ -0,0 +1,257 @@ +--- +title: Make - Facebook Actor integration +description: Learn about Facebook scraper modules, extract posts, comments, and profile data from Facebook. +sidebar_label: Facebook +sidebar_position: 8 +slug: /integrations/make/facebook +unlisted: true +--- + +## Apify Scraper for Facebook Data + +The Facebook Scraper modules from [Apify](https://apify.com/) allow you to extract posts, comments, and profile data from Facebook. + +To use these modules, you need an [Apify account](https://console.apify.com) and an [API token](https://docs.apify.com/platform/integrations/api#api-token). You can find your token in the [Apify Console](https://console.apify.com/) under **Settings > Integrations**. After connecting, you can automate data extraction and incorporate the results into your workflows. + +## Connect Apify Scraper for Facebook Data modules to Make + +1. Create an account at [Apify](https://console.apify.com/). You can sign up using your email, Gmail, or GitHub account. + + ![Sign up page](images/facebook/signup.png) + +1. To connect your Apify account to Make, you can use an OAuth connection (recommended) or an Apify API token. To get the Apify API token, navigate to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)** in the Apify Console. + + ![Apify Actor rental](images/facebook/actor-rental.png) + +1. Review the trial details. You won't be charged during the trial unless you actively switch to a paid plan. Click **Rent Actor** to activate your trial. + + ![Start Actor rental](images/facebook/start-rental.png) + +1. Connect your Apify account with Make, you need to get the Apify API token. In the Apify Console, navigate to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)**. + + ![Apify Console token for Make.png](images/Apify_Console_token_for_Make.png) + +1. Find your token under **Personal API tokens** section. You can also create a new API token with multiple customizable permissions by clicking on **+ Create a new token**. +1. Click the **Copy** icon next to your API token to copy it to your clipboard. Then, return to your Make scenario interface. + + ![Apify token on Make.png](images/Apify_token_on_Make.png) + +1. In Make, click **Add** to open the **Create a connection** dialog of the chosen Apify Scraper module. +1. In the **API token** field, paste the API token you copied from Apify. Provide a clear **Connection name**, and click **Save**. + + ![Make API token](images/facebook/make-api-token.png) + +Once connected, you can build workflows to automate Facebook data extraction and integrate results into your applications. + +## Apify Scraper for Facebook Data modules + +After connecting the app, you can use one of the three existing Search modules as native scrapers to extract public data from Facebook. + +### Extract Facebook groups + +Get data via Apify's Facebook Groups Scraper. Just add one or multiple URLs of public groups you want to extract data from, then indicate a number of posts, and optionally, choose a sorting order and date filter. + +For each given Facebook group URL, you will extract: + +- _Post details_: post ID, legacy ID, Facebook group URL, direct post URL, post text, timestamp, and Facebook feedback ID. +- _Engagement metrics_: likes, shares, comments, top reactions, and breakdown by type (like, love, wow, care, haha). +- _User (post author)_: user ID and name. +- _Attachments_: media set URL, image thumbnail, full image URL, dimensions, OCR text (if any), media ID, and owner ID. +- _Top comments_: comment ID, comment URL, timestamp, text, feedback ID, commenter ID and name, profile picture, likes count, and threading depth. + +```json title="Profile data, shortened sample" +[ + { + "facebookUrl": "https://www.facebook.com/groups/WeirdSecondhandFinds", + "url": "https://www.facebook.com/groups/WeirdSecondhandFinds/permalink/3348022435381946/", + "time": "2025-04-09T15:34:31.000Z", + "user": { + "name": "Author name" + }, + "text": "4/9/2025 - This glass fish was found at a friend's yard sale and for some reason it had to come home with me. Any ideas on how to display it?", + "reactionLikeCount": 704, + "reactionLoveCount": 185, + "reactionWowCount": 10, + "reactionCareCount": 6, + "reactionHahaCount": 3, + "attachments": [ + { + "url": "https://www.facebook.com/media/set/?set=pcb.3348022435381946&type=1", + "thumbnail": "https://scontent.fcgh33-1.fna.fbcdn.net/v/t39.30808-6/490077910_10228674979643758_5977579619381197326_n.jpg?stp=dst-jpg_s600x600_tt6" + } + ], + "likesCount": 908, + "sharesCount": 3, + "commentsCount": 852, + "topComments": [ + { + "commentUrl": "https://www.facebook.com/groups/WeirdSecondhandFinds/permalink/3348022435381946/?comment_id=3348201365364053", + "text": "Would this work okay? Water and floating candle?", + "profileName": "Bonnie FireUrchin Lambourn", + "likesCount": 2 + } + ], + "facebookId": "650812835102933", + "groupTitle": "Weird (and Wonderful) Secondhand Finds That Just Need To Be Shared" + } +] +``` + +### Extract Facebook comments + +Use the Facebook Comment Scraper to collect comments from Facebook posts. Add the post URLs, set the number of comments you want, and optionally choose comment order and whether to include replies. + +You’ll get: + +- _Text_: Comment text +- _Timestamp_: Date and time of the comment +- _Like count_: Number of likes on the comment +- _Commenter info_: Username, profile picture, profile URL, user ID +- _Number of replies_: Number of replies to the comment (not included in this example) +- _Post URL_: Link to the post the comment is associated with +- _Nested replies_: Nested replies to the comment (not included in this example) + +:::note Free plan limitations + +Features like _replies_ and _comment sorting_ are limited for users on Apify's Free Plan. Consider upgrading to a [paid subscription](https://apify.com/pricing). + +::: + +```json title="Example (shortened)" +[ + { + "facebookUrl": "https://www.facebook.com/NASAJSC/posts/pfbid0ohxEG5cJnm3JNFodkvsehRUY3yfLx5Vis8cude7xRdmrXV9EMDxsuScPaSCtX9KNl?locale=cs_CZ", "commentUrl": "https://www.facebook.com/NASAJSC/posts/pfbid0ohxEG5cJnm3JNFodkvsehRUY3yfLx5Vis8cude7xRdmrXV9EMDxsuScPaSCtX9KNl?comment_id=2386082985122451", + "id": "Y29tbWVudDoxMDU1NDAzMDgzMzY4Mzk1XzIzODYwODI5ODUxMjI0NTE=", "feedbackId": "ZmVlZGJhY2s6MTA1NTQwMzA4MzM2ODM5NV8yMzg2MDgyOTg1MTIyNDUx", "date": "2025-04-09T18:39:23.000Z", + "text": "Green is my favorite color. The beach my peaceful place. When I visited I was amazed at all the green and to see the beach area. Very cool", + "profileUrl": "https://www.facebook.com/people/Elizabeth-Grindrod/pfbid022LryhRGvvGeZrrHq6SeS95doHdjDg7WHfaJHErzcEiNF8KPHiTx3drT9pw3oKMKTl/", + "profilePicture": "https://scontent-bkk1-1.xx.fbcdn.net/v/t39.30808-1/489953042_122145581006424177_4615090019565194474_n.jpg?stp=cp0_dst-jpg_s32x32_tt6&_nc_cat=109&ccb=1-7&_nc_sid=e99d92&_nc_ohc=fJU9pA6IZpkQ7kNvwFulSHc&_nc_oc=AdldBxtJX_EilisOewldRrGT1dHWEFd690Wt6nWFTEVLY9-rlYNGHFTlMjgjB5bDsAM&_nc_zt=24&_nc_ht=scontent-bkk1-1.xx&_nc_gid=Kbf_nt_NCH2lzg1SIjTdHg&oh=00_AfGKLaCo8R4odY5OLT4esFDzvURJ46R6dxwCE0fD8jJR2A&oe=67FCA025", + "profileId": "pfbid022LryhRGvvGeZrrHq6SeS95doHdjDg7WHfaJHErzcEiNF8KPHiTx3drT9pw3oKMKTl", + "profileName": "Elizabeth Grindrod", + "likesCount": "2", + "threadingDepth": 0, + "facebookId": "1055403083368395", +] +``` + +### Extract Facebook posts + +Use the Facebook Post Scraper to get post data by adding one or multiple page URLs and the amount of posts you want to scrape. + +You’ll get: + +- _Post URL_: Link to the post +- _Shortcode_: Unique identifier for the post +- _Timestamp_: Date and time of the post +- _Content type_: Whether it’s an image, video, or carousel +- _Caption_: Text content of the post +- _Hashtags_: List of hashtags used in the post +- _Mentions_: Usernames of mentioned accounts +- _Likes_: Number of likes on the post +- _Comments_: Number of comments on the post +- _Shares_: Number of times the post has been shared +- _Media info_: + - _URLs_: Links to media files + - _Type_: Whether it's an image or video + - _Dimensions_: Size of the media +- _Owner info_: + - _Username_: Account name of the post owner + - _User ID_: Unique identifier for the owner + - _Full name_: Full name of the account holder +- _Tags_: Hashtags used in the post +- _Location_: Geographic location tagged in the post (if available) + +```json title="Example (shortened)" +[ + { + "facebookUrl": "https://www.facebook.com/nasa", + "postId": "1215784396583601", + "pageName": "NASA", + "url": "https://www.facebook.com/NASA/posts/pfbid029aLb3sDGnXuYA5P7DK5uRT7Upf39X5fwCBFcRz9C3M4EMShwJWNwLLaXA5RdYeyKl", + "time": "2025-04-07T19:09:00.000Z", + "user": { + "id": "100044561550831", + "name": "NASA - National Aeronautics and Space Administration", + "profileUrl": "https://www.facebook.com/NASA", + "profilePic": "https://scontent.fbog3-2.fna.fbcdn.net/v/t39.30808-1/243095782_416661036495945_3843362260429099279_n.png?stp=cp0_dst-png_s40x40&_nc_cat=1&ccb=1-7&_nc_sid=2d3e12&_nc_ohc=pGNKYYiG82gQ7kNvwGLgqmB&_nc_oc=AdmpIOT7GNKe9qxJgFM-EEuF78UvDx97YygzhxiRXW5nXDyZmQScZzHnWAFlGmn8VBk" + }, + "text": "It’s your time to shine! This Citizen Science Month, contribute to a NASA Citizen Science project that will help improve life on Earth and solve cosmic mysteries.", + "link": "https://science.nasa.gov/citizen-science/", + "likes": 2016, + "comments": 171, + "shares": 217, + "media": [ + { + "thumbnail": "https://scontent.fbog3-3.fna.fbcdn.net/v/t39.30808-6/489419147_1215784366583604_2492050236576327908_n.jpg?stp=dst-jpg_s720x720_tt6&_nc_cat=110&ccb=1-7&_nc_sid=127cfc&_nc_ohc=YI6mnyIKJmwQ7kNvwGVLR7C&_nc_oc=AdklMZgJuQZ-r924q5F9ikY0F5E_LF2gbzNnepx75qTmtJ-jDnq6Ve-VkIQ1hcaCDhA" + } + ] + }, + { + "facebookUrl": "https://www.facebook.com/nasa", + "postId": "1215717559923618", + "pageName": "NASA", + "url": "https://www.facebook.com/NASA/posts/pfbid01SDwDikd344679WW4Er1F1UAB3cfpBH4Ud54RJEaTtD1Fih2xSzjtsCsYXgbh93Ll", + "time": "2025-04-07T17:04:00.000Z", + "user": { + "id": "100044561550831", + "name": "NASA - National Aeronautics and Space Administration", + "profileUrl": "https://www.facebook.com/NASA", + "profilePic": "https://scontent.fbog3-2.fna.fbcdn.net/v/t39.30808-1/243095782_416661036495945_3843362260429099279_n.png?stp=cp0_dst-png_s40x40&_nc_cat=1&ccb=1-7&_nc_sid=2d3e12&_nc_ohc=pGNKYYiG82gQ7kNvwGLgqmB&_nc_oc=AdmpIOT7GNKe9qxJgFM-EEuF78UvDx97YygzhxiRXW5nXDyZmQScZzHnWAFlGmn8VBk" + }, + "text": "NASA's Hubble Space Telescope has studied Uranus for more than 20 years and is still learning more about its gas.", + "link": "https://go.nasa.gov/3RIapAw", + "likes": 1878, + "comments": 144, + "shares": 215, + "media": [ + { + "thumbnail": "https://scontent.fbog3-1.fna.fbcdn.net/v/t39.30808-6/489532065_1215717536590287_873488674466633974_n.jpg?stp=dst-jpg_p180x540_tt6&_nc_cat=109&ccb=1-7&_nc_sid=127cfc&_nc_ohc=kAiP3avgomkQ7kNvwGOb-YS&_nc_oc=Adn31Ca9oiQ5ieTtUtFqcr45R4jdJdVxei1kMR1kj-RLDehS-fyEVJD1fY2-5IItLe0" + } + ] + }, + { + "facebookUrl": "https://www.facebook.com/nasa", + "postId": "1212614090233965", + "pageName": "NASA", + "url": "https://www.facebook.com/NASA/videos/958890849561531/", + "time": "2025-04-03T18:06:29.000Z", + "user": { + "id": "100044561550831", + "name": "NASA - National Aeronautics and Space Administration", + "profileUrl": "https://www.facebook.com/NASA", + "profilePic": "https://scontent.fssz1-1.fna.fbcdn.net/v/t39.30808-1/243095782_416661036495945_3843362260429099279_n.png?stp=cp0_dst-png_s40x40&_nc_cat=1&ccb=1-7&_nc_sid=2d3e12&_nc_ohc=pGNKYYiG82gQ7kNvwGLgqmB&_nc_oc=AdmpIOT7GNKe9qxJgFM-EEuF78UvDx97YygzhxiRXW5nXDyZmQScZzHnWAFlGmn8VBk" + }, + "text": "Rocket? Stacking. Crew training? Underway. Mission patch? Ready to go.", + "link": "https://go.nasa.gov/41ZErWJ", + "likes": 1813, + "comments": 190, + "shares": 456, + "media": [ + { + "thumbnail": "https://scontent.fssz1-1.fna.fbcdn.net/v/t15.5256-10/488073346_1027101039315356_6805938007276905855_n.jpg?_nc_cat=109&ccb=1-7&_nc_sid=7965db&_nc_ohc=M4hIzfAIbdAQ7kNvwFnbXVw&_nc_oc=AdmJODt8am5l58TuwIbYLbEMK_w9IFb6uaUqiq7SCtNI9ouf4Xd_nZcifKpRLWSsclg" + } + ] + } +] +``` + +## Other scrapers available + +Looking for more than just Facebook? You can use other native Make apps powered by Apify: + +- TikTok Data +- YouTube Data +- Instagram Data +- Google Search Data +- Google Maps Email Data +- Amazon Data + +- [Instagram Data](/platform/integrations/make/instagram) +- [TikTok Data](/platform/integrations/make/tiktok) +- [Google Search](/platform/integrations/make/search) +- [Google Maps Emails Data](/platform/integrations/make/maps) +- [YouTube Data](/platform/integrations/make/youtube) +- [AI crawling](/platform/integrations/make/ai-crawling) +- [Amazon](/platform/integrations/make/amazon) + +And more! Because you can access any of our 4,500+ scrapers on Apify Store by using the [general Apify connections](https://www.make.com/en/integrations/apify). + diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/Apify_Console_token_for_Make.png b/sources/platform/integrations/workflows-and-notifications/make/images/Apify_Console_token_for_Make.png new file mode 100644 index 0000000000..6fa81f1355 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/Apify_Console_token_for_Make.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/Apify_token_on_Make.png b/sources/platform/integrations/workflows-and-notifications/make/images/Apify_token_on_Make.png new file mode 100644 index 0000000000..7cbf4b4216 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/Apify_token_on_Make.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/ai-crawling/image 1.png b/sources/platform/integrations/workflows-and-notifications/make/images/ai-crawling/image 1.png new file mode 100644 index 0000000000..f60273be5f Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/ai-crawling/image 1.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/ai-crawling/image.png b/sources/platform/integrations/workflows-and-notifications/make/images/ai-crawling/image.png new file mode 100644 index 0000000000..ffe76c0727 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/ai-crawling/image.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/ai-crawling/wcc-signup.png b/sources/platform/integrations/workflows-and-notifications/make/images/ai-crawling/wcc-signup.png new file mode 100644 index 0000000000..ce6fcf2745 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/ai-crawling/wcc-signup.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/amazon/image.png b/sources/platform/integrations/workflows-and-notifications/make/images/amazon/image.png new file mode 100644 index 0000000000..7d449c1239 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/amazon/image.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/amazon/image1.png b/sources/platform/integrations/workflows-and-notifications/make/images/amazon/image1.png new file mode 100644 index 0000000000..fbc1259da6 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/amazon/image1.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/facebook/actor-rental.png b/sources/platform/integrations/workflows-and-notifications/make/images/facebook/actor-rental.png new file mode 100644 index 0000000000..fd8c34d983 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/facebook/actor-rental.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/facebook/make-api-token.png b/sources/platform/integrations/workflows-and-notifications/make/images/facebook/make-api-token.png new file mode 100644 index 0000000000..f44be18bb0 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/facebook/make-api-token.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/facebook/signup.png b/sources/platform/integrations/workflows-and-notifications/make/images/facebook/signup.png new file mode 100644 index 0000000000..7ff0a4116d Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/facebook/signup.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/facebook/start-rental.png b/sources/platform/integrations/workflows-and-notifications/make/images/facebook/start-rental.png new file mode 100644 index 0000000000..1685e7e723 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/facebook/start-rental.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/instagram/Apify_Make_Sign_up_page.png b/sources/platform/integrations/workflows-and-notifications/make/images/instagram/Apify_Make_Sign_up_page.png new file mode 100644 index 0000000000..d6d79a4fbc Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/instagram/Apify_Make_Sign_up_page.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/instagram/Apify_Token_for_modules_on_Make.png b/sources/platform/integrations/workflows-and-notifications/make/images/instagram/Apify_Token_for_modules_on_Make.png new file mode 100644 index 0000000000..070fe06a62 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/instagram/Apify_Token_for_modules_on_Make.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/maps/Screenshot_2025-04-22_at_12.45.33.png b/sources/platform/integrations/workflows-and-notifications/make/images/maps/Screenshot_2025-04-22_at_12.45.33.png new file mode 100644 index 0000000000..999e4e581f Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/maps/Screenshot_2025-04-22_at_12.45.33.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/maps/image.png b/sources/platform/integrations/workflows-and-notifications/make/images/maps/image.png new file mode 100644 index 0000000000..ffe76c0727 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/maps/image.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/maps/maps-signup.png b/sources/platform/integrations/workflows-and-notifications/make/images/maps/maps-signup.png new file mode 100644 index 0000000000..582b9fd9b8 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/maps/maps-signup.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/search/image 1.png b/sources/platform/integrations/workflows-and-notifications/make/images/search/image 1.png new file mode 100644 index 0000000000..3630060e7c Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/search/image 1.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/search/image.png b/sources/platform/integrations/workflows-and-notifications/make/images/search/image.png new file mode 100644 index 0000000000..ffe76c0727 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/search/image.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/search/search-signup.png b/sources/platform/integrations/workflows-and-notifications/make/images/search/search-signup.png new file mode 100644 index 0000000000..22aa94edf0 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/search/search-signup.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/tiktok/image.png b/sources/platform/integrations/workflows-and-notifications/make/images/tiktok/image.png new file mode 100644 index 0000000000..ffe76c0727 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/tiktok/image.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/tiktok/image1.png b/sources/platform/integrations/workflows-and-notifications/make/images/tiktok/image1.png new file mode 100644 index 0000000000..efe45cfe36 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/tiktok/image1.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/youtube/image.png b/sources/platform/integrations/workflows-and-notifications/make/images/youtube/image.png new file mode 100644 index 0000000000..c9b8ed80ba Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/youtube/image.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make/images/youtube/image1.png b/sources/platform/integrations/workflows-and-notifications/make/images/youtube/image1.png new file mode 100644 index 0000000000..98baaff3e2 Binary files /dev/null and b/sources/platform/integrations/workflows-and-notifications/make/images/youtube/image1.png differ diff --git a/sources/platform/integrations/workflows-and-notifications/make.md b/sources/platform/integrations/workflows-and-notifications/make/index.md similarity index 83% rename from sources/platform/integrations/workflows-and-notifications/make.md rename to sources/platform/integrations/workflows-and-notifications/make/index.md index 49987eb967..9e23bfcd09 100644 --- a/sources/platform/integrations/workflows-and-notifications/make.md +++ b/sources/platform/integrations/workflows-and-notifications/make/index.md @@ -10,7 +10,7 @@ slug: /integrations/make --- -[Make](https://www.make.com/) *(formerly Integromat)* allows you to create scenarios where you can integrate various services (modules) to automate and centralize jobs. Apify has its own module you can use to run Apify Actors, get notified about run statuses, and receive Actor results directly in your Make scenario. +[Make](https://www.make.com/) _(formerly Integromat)_ allows you to create scenarios where you can integrate various services (modules) to automate and centralize jobs. Apify has its own module you can use to run Apify Actors, get notified about run statuses, and receive Actor results directly in your Make scenario. ## Connect Apify to Make {#connect-apify-to-make} @@ -25,19 +25,22 @@ Add the Apify module to your scenario. You can find this module by searching for Next, select one of the available options under Triggers, Actions and Searches, then click on the Apify module to open its configuration window. -![Apify module](../images/apify-module.png) +![Apify module](../../images/apify-module.png) ### Create a connection to Apify -In the Connection configuration window, you will need to provide your Apify API token. +In the Connection configuration window, you'll authorize the connection between Make and Apify. The recommended method is to use an OAuth connection. +Alternatively, you can choose to connect using Apify API token: -![API token](../images/apify-token.png) +1. You will need to provide your Apify API token in the designated field. -You can find the token in the Apify Console by navigating to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)**. + ![API token](../../images/apify-token.png) -![Integrations token](../images/apify-integrations-token.png) +1. You can find this token in the Apify Console by navigating to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)** -Finally, copy your API token to the Make module and save it to create a connection. + ![Integrations token](../../images/apify-integrations-token.png) + +1. Finally, copy your API token from Apify, paste it into the Make module, and save to create the connection. Congratulations! You have successfully connected the Apify app and can now use it in your scenarios. @@ -49,8 +52,10 @@ We have two methods to run an Actor or task and retrieve its data in Make.com, d - **Asynchronous run using the trigger module** :::info + Make.com imposes a hard timeout for synchronous runs, the timeout varies based on your plan. If the Actor or task takes longer than the timeout to complete, the data will not be fully returned. If you anticipate that the Actor run will exceed the timeout, use the asynchronous method with a trigger module instead. + ::: The primary difference between the two methods is that the synchronous run waits for the Actor or task to finish and retrieves its output using the "Get Dataset Items" module. By contrast, the asynchronous run watches for the run of an Actor or task (which could have been triggered from another scenario, manually from Apify console or elsewhere) and gets its output once it finishes. @@ -68,7 +73,7 @@ Next, add the Apify module called "Run an Actor" to your scenario and configure For this example, we will use the "Google Maps Review Scraper" Actor. Make sure to set the "Run synchronously" option to "Yes," so the module waits for the Actor to finish run. -![make-com-sync-2.png](../images/make-com/make-com-sync-2.png) +![make-com-sync-2.png](../../images/make-com/make-com-sync-2.png) #### Step 2: Add the Apify "Get Dataset Items" module @@ -77,7 +82,7 @@ In the next step, add the "Get Dataset Items" module to your scenario, which is In the "Dataset ID" field, provide the default dataset ID from the Actor run. You can find this dataset ID in the variables generated by the previous "Run an Actor" module. If the variables do not appear, run the scenario first, then check again. -![make-com-sync-3.png](../images/make-com/make-com-sync-3.png) +![make-com-sync-3.png](../../images/make-com/make-com-sync-3.png) #### Step 3: Add the Google Sheets "Create Spreadsheet Rows" module @@ -85,7 +90,7 @@ Finally, add the Google Sheets "Bulk Add Rows" module to your scenario. This mod In the "Spreadsheet ID" field, provide the ID of the target Google Sheets file, which you can find in its URL. Configure the column range (e.g., "A-Z") and map the data retrieved from the "Get Dataset Items" module to the row values. -![make-com-sync-4.png](../images/make-com/make-com-sync-4.png) +![make-com-sync-4.png](../../images/make-com/make-com-sync-4.png) You’re all set! Once the scenario is started, it will run the Actor synchronously and export its output to your Google Sheets file. @@ -101,7 +106,7 @@ Next, add the Apify module called "Watch Actor Runs" to your scenario. This modu For this example, we will use the "Google Maps Review Scraper" Actor. -![make-com-async-1.png](../images/make-com/make-com-async-1.png) +![make-com-async-1.png](../../images/make-com/make-com-async-1.png) #### Step 2: Add the Apify "Get Dataset Items" module @@ -109,7 +114,7 @@ Add the "Get Dataset Items" module to your scenario to retrieve the output of th In the "Dataset ID" field, provide the default dataset ID from the Actor run. You can find the dataset ID in the variables generated by the "Watch Actor Runs" module. -![make-com-async-2.png](../images/make-com/make-com-async-2.png) +![make-com-async-2.png](../../images/make-com/make-com-async-2.png) #### Step 3: Add the Google Sheets "Create Spreadsheet Rows" module @@ -117,7 +122,7 @@ Finally, add the Google Sheets "Bulk Add Rows" module to your scenario, which wi In the "Spreadsheet ID" field, enter the ID of the target Google Sheets file, which you can find in its URL. Configure the column range (e.g., "A-Z") and map the data retrieved from the "Get Dataset Items" module to the row values. -![make-com-async-3.png](../images/make-com/make-com-async-3.png) +![make-com-async-3.png](../../images/make-com/make-com-async-3.png) That’s it! Once the Actor run is complete, its data will be exported to the Google Sheets file. You can initiate the Actor run via the Apify console, a scheduler, or from another Make.com scenario. diff --git a/sources/platform/integrations/workflows-and-notifications/make/instagram.md b/sources/platform/integrations/workflows-and-notifications/make/instagram.md new file mode 100644 index 0000000000..3dd46b00ad --- /dev/null +++ b/sources/platform/integrations/workflows-and-notifications/make/instagram.md @@ -0,0 +1,191 @@ +--- +title: Make - Instagram Actor integration +description: Learn about Instagram scraper modules. Extract posts, comments, and profile data. +sidebar_label: Instagram +sidebar_position: 1 +slug: /integrations/make/instagram +--- + +**Learn about Instagram scraper modules. Extract posts, comments, and profile data.** + +--- + +## Apify Scraper for Instagram Data + +The Instagram Scraper modules from [Apify](https://apify.com) allow you to extract posts, comments, and profile data from Instagram. + +To use these modules, you need an [Apify account](https://console.apify.com) and an [API token](https://docs.apify.com/platform/integrations/api#api-token). You can find your token in the [Apify Console](https://console.apify.com/) under **Settings > Integrations**. After connecting, you can automate data extraction and incorporate the results into your workflows. + +## Connect Apify Scraper for Instagram Data modules to Make + +1. Create an account at [Apify](https://console.apify.com/). You can sign up using your email, Gmail, or GitHub account. + + ![Sign up page](images/instagram/Apify_Make_Sign_up_page.png) + +1. To connect your Apify account to Make, you can use an OAuth connection (recommended) or an Apify API token. To get the Apify API token, navigate to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)** in the Apify Console. + + ![Apify Console token for Make.png](images/Apify_Console_token_for_Make.png) + +1. Find your token under **Personal API tokens** section. You can also create a new API token with multiple customizable permissions by clicking on **+ Create a new token**. +1. Click the **Copy** icon next to your API token to copy it to your clipboard. Then, return to your Make scenario interface. + + + ![Apify token on Make.png](images/Apify_token_on_Make.png) + +1. In Make, click **Add** to open the **Create a connection** dialog of the chosen Apify Scraper module. +1. In the **API token** field, paste the API token you copied from Apify. Provide a clear **Connection name**, and click **Save**. + + ![Apify Token for modules on Make.png](images/instagram/Apify_Token_for_modules_on_Make.png) + +Once connected, you can build workflows to automate Instagram data extraction and integrate results into your applications. + +## Apify Scraper for Instagram Data modules + +After connecting, you can use one of the three existing Search modules as native scrapers to extract public data from Instagram. + +### Extract Instagram profiles + +Get profile details via [Apify's Instagram Profiles Scraper](https://apify.com/apify/instagram-profile-scraper). All you need to set up is usernames or URLs you want to extract data from. + +For each Instagram profile, you will extract: + +- _Basic profile details_: username, full name, biography, and profile URL. +- _Account status_: verification status, whether the account is private or public, and if it's a business account. +- _Follower and engagement metrics_: number of followers and accounts followed. +- _Profile pictures_: standard and HD profile picture URLs. +- _External links_: website URL (if provided). +- _Content information_: number of IGTV videos and highlight reels. +- _Related profiles_: suggested accounts, including their username, full name, profile picture URL, and verification status. + +```json title="Profile data, shortened sample" +[ + { + "fullName": "NASA", + "profilePicUrl": "https://scontent-atl3-2.cdninstagram.com/v/t51.2885-19/29090066_159271188110124_1152068159029641216_n.jpg?stp=dst-jpg_e0_s150x150_tt6&_nc_ht=scontent-atl3-2.cdninstagram.com&_nc_cat=1&_nc_oc=Q6cZ2AHA8W2z8Q8c-m6E-NgP2su5m59iPYiKVnQlhOBQsfJhVbSzs1AMZMECpvJPB_LanuQ&_nc_ohc=1vXGhkEoh-oQ7kNvgErK0o3&_nc_gid=f2687478a00141a1b759031727c45f9c&edm=AOQ1c0wBAAAA&ccb=7-5&oh=00_AYBBdI58EkpbDvplnxGKsqMUNzd7IYS1GzG-F3fb493okg&oe=67B983E9&_nc_sid=8b3546", + "username": "nasa", + "postsCount": 4381, + "followersCount": 96718778, + "followsCount": 81, + "private": false, + "verified": true, + "isBusinessAccount": true, + "biography": "🚀 🌎 Exploring the universe and our home planet. Verification: nasa.gov/socialmedia" + }, + { + "fullName": "National Geographic", + "profilePicUrl": "https://scontent-lga3-3.cdninstagram.com/v/t51.2885-19/476424694_3911047592506753_8995392926225146489_n.jpg?stp=dst-jpg_e0_s150x150_tt6&_nc_ht=scontent-lga3-3.cdninstagram.com&_nc_cat=1&_nc_oc=Q6cZ2AHN-FkuOj4TjoJuFvCdSEHSAA2nPN9hSjUK1b1phJY5bDOJjsQVtvzHguB7UvZVA78&_nc_ohc=Nw5ra__Z3vEQ7kNvgG9nmDU&_nc_gid=dfd92e92eeda46f99367b1eaa093ff3a&edm=AOQ1c0wBAAAA&ccb=7-5&oh=00_AYDUu2rnJb1CKhHODZr7GGg142G24F_Sxb0cVh7gRqUn1g&oe=67B97B88&_nc_sid=8b3546", + "username": "natgeo", + "postsCount": 30103, + "followersCount": 279573878, + "followsCount": 167, + "private": false, + "verified": true, + "isBusinessAccount": true, + "biography": "Inspiring the explorer in everyone 🌎" + } +] +``` + +### Extract Instagram comments + +Retrieve comments from posts by calling [Apify's Instagram Comments Scraper](https://apify.com/apify/instagram-comment-scraper). To set up this module, you will need to add Instagram posts or reels to extract the comments from, the desired number of comments, and optionally, the order of comments, and replies. + +For each Instagram post, you will extract: + +- _Comment details_: comment text, timestamp, and number of likes. +- _Commenter profile_: username, full name, profile picture URL, and account status (private or public). +- _Engagement data_: number of replies and whether the commenter is verified. +- _Post association_: URL of the Instagram post the comment belongs to. +- _Replies (if any)_: nested replies under the main comment. + +:::note Free plan limitatios + +Features like _replies_ and _newest comments first_ are limited for users on Apify's Free Plan. To access the newest comment sorting or more than 20 replies per comment, consider upgrading to a [paid subscription](https://apify.com/pricing). + +::: + +```json title="Comment data, shortened sample" +[ + { + "text": "So beautiful 🥲🥹✨", + "timestamp": "2024-10-24T10:16:00.000Z", + "ownerUsername": "im_sanaz3", + "ownerProfilePicUrl": "https://scontent-ber1-1.cdninstagram.com/v/t51.2885-19/475976048_1321670355521757_8632924050781709835_n.jpg?stp=dst-jpg_e0_s150x150_tt6&_nc_ht=scontent-ber1-1.cdninstagram.com&_nc_cat=109&_nc_oc=Q6cZ2AHRZYgJDKz3fcI9QKX0mLmjyXeZOpQxGcUhRqH71pVWJMe0YOr2d7BqTu5-kLCdJsU&_nc_ohc=Z8izKMKm5QAQ7kNvgGSfNLs&_nc_gid=f12dbe88e285431d800ffc93637264f1&edm=AId3EpQBAAAA&ccb=7-5&oh=00_AYAacAhAy2-oAy8D-_z_MP_2sI59yqf9t5tdz5uvrlH3NA&oe=67B9A2A2&_nc_sid=f5838a", + "postUrl": "https://www.instagram.com/p/DBea8-8Jn2z/" + }, + "text": "So something gonna hit earth? Since we see stories all over internet. Please give us the details 😂", + "timestamp": "2025-02-11T19:01:03.000Z", + "ownerUsername": "isabellain_", + "ownerProfilePicUrl": "https://scontent-ber1-1.cdninstagram.com/v/t51.2885-19/477089999_1404980843702640_3169514283121086597_n.jpg?stp=dst-jpg_e0_s150x150_tt6&_nc_ht=scontent-ber1-1.cdninstagram.com&_nc_cat=100&_nc_oc=Q6cZ2AHRZYgJDKz3fcI9QKX0mLmjyXeZOpQxGcUhRqH71pVWJMe0YOr2d7BqTu5-kLCdJsU&_nc_ohc=f3WerXJOT3IQ7kNvgGSWaW3&_nc_gid=f12dbe88e285431d800ffc93637264f1&edm=AId3EpQBAAAA&ccb=7-5&oh=00_AYAXqkREDSM9YNfa14dKLPp8uuHQgwAIb_zKvYA4W_I_Pg&oe=67B98B5E&_nc_sid=f5838a", + "postUrl": "https://www.instagram.com/p/DBea8-8Jn2z/" + }, + { + "text": "Please archive ALL of your articles and research with and about women making history with NASA before you remove the data from your websites. And while you’re at it, remove the word men and stick to just names, fair is fair and there won’t be any sex called out in any of your articles.", + "timestamp": "2025-02-11T15:40:44.000Z", + "ownerUsername": "hippiesoulmo", + "ownerProfilePicUrl": "https://scontent-ber1-1.cdninstagram.com/v/t51.2885-19/471553535_3637106739845033_7912985502669751019_n.jpg?stp=dst-jpg_e0_s150x150_tt6&_nc_ht=scontent-ber1-1.cdninstagram.com&_nc_cat=105&_nc_oc=Q6cZ2AHRZYgJDKz3fcI9QKX0mLmjyXeZOpQxGcUhRqH71pVWJMe0YOr2d7BqTu5-kLCdJsU&_nc_ohc=2NKox-3InPkQ7kNvgHMdSEH&_nc_gid=f12dbe88e285431d800ffc93637264f1&edm=AId3EpQBAAAA&ccb=7-5&oh=00_AYD1tLwbEVW58ey9hxlvkO6nFKVr-VmIgzbZFPnF3mL83w&oe=67B9942E&_nc_sid=f5838a", + "postUrl": "https://www.instagram.com/p/DBea8-8Jn2z/" + } + ] +``` + +### Extract Instagram posts + +Gather post data with [Apify's Instagram Post Scraper](https://apify.com/apify/instagram-post-scraper). To set up this module, you will need to add Instagram usernames to extract the post from, the desired number of posts, and the timeframe of the posts. + +For each Instagram post, you will extract: + +- _Post details_: post URL, content type (image, video, carousel), shortcode, post ID, and timestamp. +- _Text content_: caption, hashtags, and mentions. +- _Engagement metrics_: number of likes and comments, including a few latest comments. +- _Media details_: image dimensions (height and width), display URL, and alternative text (if available). +- _User information_: owner’s username, full name (if available), and user ID. +- _Additional data_: tagged users, child posts (for carousel posts), and location details (if available). + +```json title="Post data, shortened sample" +[ + { + "caption": "A supernova glowing in the dark 🌟⁣\n ⁣\nWhen supernova remnant SN 1006 first appeared in the sky in 1006 C.E., it was far brighter than Venus and visible during the daytime for weeks. From that moment on, it occupied the hearts of astronomers all over the world; it has been studied from the ground and from space many times.⁣\n ⁣\nIn this image, visible, radio, and X-ray data combine to give us that blue (and red) view of the remnant’s full shell – the debris field that was created when a white dwarf star exploded and sent material hurtling into space.⁣\n ⁣\nScientists believe SN 1006 is a Type Ia supernova. This class of supernova is caused when a white dwarf never lets another star go: either it pulls too much mass from a companion star and explodes, or it merges with another white dwarf and explodes. Understanding Type Ia supernovas is especially important because astronomers use observations of these explosions in distant galaxies as mileposts to mark the expansion of the universe.⁣\n ⁣\nImage description: This supernova remnant looks like a bubble filled with blue and red clouds of dust and gas, floating amid a million stars. These stars are visible all around the bubble and even can be seen peeking through it.⁣\n ⁣\nCredit: NASA, ESA, and Z. Levay (STScI)⁣\n ⁣\n#NASA #Supernova #Stars #IVE #Astronomy #Hubble #Chandra #Clouds #아이브 #SupernovaLove #DavidGuetta", + "ownerFullName": "NASA", + "ownerUsername": "nasa", + "url": "https://www.instagram.com/p/DCHmqs1NoaJ/", + "commentsCount": 3565, + "firstComment": "🔥🙌❤️👏", + "likesCount": 1214485, + "timestamp": "2024-11-08T17:30:07.000Z" + }, + { + "caption": "Take a deep breath...\n\nX-ray images from our Chandra X-ray Observatory helped astronomers confirm that most of the oxygen in the universe is synthesized in massive stars. So, everybody say \"thank you\" to supernova remnants (SNRs) like this one, which has enough oxygen for thousands of solar systems.\n\nSupernova remnants are, naturally, the remains of exploded stars. They're extremely important for understanding our galaxy. If it weren't for SNRs, there would be no Earth, no plants, animals, or people. This is because all the elements heavier than iron were made in a supernova explosion, so the only reason we find these elements on Earth or in our solar system — or any other extrasolar planetary system — is because those elements were formed during a supernova.\n\n@nasachandraxray's data is represented in this image by blue and purple, while optical data from @nasahubble and the Very Large Telescope in Chile are in red and green.\n\nImage description: The darkness of space is almost covered by the array of objects in this image. Stars of different sizes are strewn about, while a blue and red bubble of gas is at the center. An area of pink and green covers the bottom-right corner.\n\nCredit: X-ray (NASA/CXC/ESO/F.Vogt et al); Optical (ESO/VLT/MUSE), Optical (NASA/STScI)\n\n#NASA #Supernova #Space #Universe #Astronomy #Astrophotography #Telescope #Xray", + "ownerFullName": "NASA", + "ownerUsername": "nasa", + "url": "https://www.instagram.com/p/DBKBByizDHZ/", + "commentsCount": 2050, + "firstComment": "👍", + "likesCount": 1020495, + "timestamp": "2024-10-15T19:27:29.000Z" + }, + { + "caption": "It’s giving rainbows and unicorns, like a middle school binder 🦄🌈 ⁣⁣\n⁣⁣\nMeet NGC 602, a young star cluster in the Small Magellanic Cloud (one of our satellite galaxies), where astronomers using @NASAWebb have found candidates for the first brown dwarfs outside of our galaxy. This star cluster has a similar environment to the kinds of star-forming regions that would have existed in the early universe—with very low amounts of elements heavier than hydrogen and helium. It’s drastically different from our own solar neighborhood and close enough to study in detail. ⁣⁣\n ⁣⁣\nBrown dwarfs are… not quite stars, but also not quite gas giant planets either. Typically they range from about 13 to 75 Jupiter masses. They are sometimes free-floating and not gravitationally bound to a star, like a planet would be. But they do share some characteristics with exoplanets, like storm patterns and atmospheric composition. ⁣⁣\n\n@NASAHubble showed us that NGC 602 harbors some very young low-mass stars; Webb is showing us how significant and extensive objects like brown dwarfs are in this cluster. Scientists are excited to better be able to understand how they form, particularly in an environment similar to the harsh conditions of the early universe.⁣⁣\n ⁣⁣\nRead more at the link in @ESAWebb’s bio. ⁣⁣\n ⁣⁣\nImage description: A two image swipe-through of a star cluster is shown inside a large nebula of many-coloured gas and dust. The material forms dark ridges and peaks of gas and dust surrounding the cluster, lit on the inner side, while layers of diffuse, translucent clouds blanket over them. Around and within the gas, a huge number of distant galaxies can be seen, some quite large, as well as a few stars nearer to us which are very large and bright.⁣⁣\n ⁣⁣\nImage Credit: ESA/Webb, NASA & CSA, P. Zeidler, E. Sabbi, A. Nota, M. Zamani (ESA/Webb)⁣⁣\n ⁣⁣\n#JWST #Webb #JamesWebbSpaceTelescope #NGC602 #browndwarf #space #NASA #ESA", + "ownerFullName": "NASA", + "ownerUsername": "nasa", + "url": "https://www.instagram.com/p/DBea8-8Jn2z/", + "commentsCount": 3356, + "firstComment": "🔥🌍", + "likesCount": 1092162, + "timestamp": "2024-10-23T17:38:49.000Z" + } +] +``` + +## Other scrapers available + +There are other native Make Apps powered by Apify. You can check out Apify Scraper for: + +- [TikTok Data](/platform/integrations/make/tiktok) +- [Google Search](/platform/integrations/make/search) +- [Google Maps Emails Data](/platform/integrations/make/maps) +- [YouTube Data](/platform/integrations/make/youtube) +- [AI crawling](/platform/integrations/make/ai-crawling) +- [Amazon](/platform/integrations/make/amazon) + +And more! Because you can access any of our 4,500+ scrapers on Apify Store by using the [general Apify connections](https://www.make.com/en/integrations/apify). diff --git a/sources/platform/integrations/workflows-and-notifications/make/maps.md b/sources/platform/integrations/workflows-and-notifications/make/maps.md new file mode 100644 index 0000000000..7a236545a5 --- /dev/null +++ b/sources/platform/integrations/workflows-and-notifications/make/maps.md @@ -0,0 +1,362 @@ +--- +title: Make - Google Maps Leads Actor integration +description: Learn about Google Maps scraper modules. +sidebar_label: Google Maps +sidebar_position: 4 +slug: /integrations/make/maps +toc_max_heading_level: 4 +--- + +## Apify Scraper for Google Maps Leads + +The Google Maps Leads Scraper modules from [apify.com](http://apify.com/) allow you to extract valuable business lead data from Google Maps, including contact information, email addresses, social media profiles, business websites, phone numbers, and detailed location data. Perfect for sales teams, marketers, and business developers looking to build targeted lead lists, marketers or other commercial teams looking to data mine reviews or assess sentiment analysis wide geographies. + +To use these modules, you need an [Apify account](https://console.apify.com/sign-up) and an [API token](https://docs.apify.com/platform/integrations/api#api-token), which you can find under **Settings > Integrations** in Apify Console. After connecting, you can automate lead generation at scale and incorporate the results into your sales and marketing workflows. + +For more details, follow the tutorial below. + +## Connect Apify Scraper for Google Maps Leads + +1. Create an account at [Apify](https://console.apify.com/). You can sign up using your email, Gmail, or GitHub account. + + ![Sign up page](images/maps/maps-signup.png) + +1. To connect your Apify account to Make, you can use an OAuth connection (recommended) or an Apify API token. To get the Apify API token, navigate to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)** in the Apify Console. + + ![Apify Console token for Make.png](images/Apify_Console_token_for_Make.png) + +1. Find your token under **Personal API tokens** section. You can also create a new API token with multiple customizable permissions by clicking on **+ Create a new token**. +1. Click the **Copy** icon next to your API token to copy it to your clipboard. Then, return to your Make scenario interface. + + ![Apify token on Make.png](images/Apify_token_on_Make.png) + +1. In Make, click **Add** to open the **Create a connection** dialog of the chosen Apify Scraper module. +1. In the **API token** field, paste the API token you copied from Apify. Provide a clear **Connection name**, and click **Save**. + + ![Make API token](images/maps/Screenshot_2025-04-22_at_12.45.33.png) + +Once connected, you can build workflows to automate Google Maps extraction and integrate results into your applications. + +## Apify Scraper for Google Maps modules + +After connecting the app, you can use one of the four existing Search modules as native scrapers to extract Google Maps Data. + +### Search with Categories + +The Search with Categories module is a component of the Google Maps Leads Scraper that allows you to discover and extract business leads by filtering places based on both search terms and categories. + +#### Key Features + +- _Category-Based Filtering_: Filter businesses using Google Maps' extensive category system with over 4,000 available options +- _Location Targeting_: Define your target market using simple location queries (city + country format) +- _Customizable Result Limit_: Control exactly how many leads to extract per search term or category +- _Language Selection_: View business information in your preferred language +- _Quality Filters_: Focus on high-quality leads by setting minimum star ratings +- _Website Availability Filter_: Target only businesses with (or without) websites +- _Exact Name Matching_: Find businesses with exact or partial name matches +- _Operational Status Filter_: Exclude temporarily or permanently closed businesses + +#### How It Works + +The module allows you to combine category filtering with location parameters to discover relevant business leads, data mine reviews, or extract relevant Google Maps information. You can use categories alone or with specific search terms to create precisely targeted lead lists. + +Categories can be general (e.g., "restaurant") which includes all variations like "Asian restaurant" or "family restaurant," or they can be specific (e.g., "restaurant terrace"). Using broader categories with a few specific search terms typically yields the best results without excluding potentially valuable leads. + +- _Business identification_: name, category, place ID for unique identification. +- _Full contact details_: phone number, website URL, email addresses (with email enrichment). +- _Complete address information_: street, city, state, postal code, country for direct mail campaigns. +- _Geographic data_: precise coordinates, neighborhood, plus codes for territory planning. +- _Business quality indicators_: ratings, number of reviews, price level to qualify leads. +- _Operational insights_: opening hours, popular times, serviceability to better target outreach. +- _Competitive intelligence_: nearby businesses, related places. +- _Additional lead qualification data (optional)_: customer reviews, business photos, social media profiles. + +```json title="Business lead data, shortened sample" +{ + "searchString": "Restaurant in Staten Island", + "rank": 3, + "title": "Kim's Island", + "placeId": "ChIJJaKM4pyKwokRCZ8XaBNj_Gw", + "categoryName": "Chinese restaurant", + "price": "$10–20", + "rating": 4.6, + "reviewsCount": 182, + "featuredInLists": ["Best Chinese Food", "Top Rated Restaurants"], + + // Complete address information for targeted outreach + "address": "175 Main St, Staten Island, NY 10307", + "neighborhood": "Tottenville", + "street": "175 Main St", + "city": "Staten Island", + "postalCode": "10307", + "state": "New York", + "countryCode": "US", + "plusCode": "GQ62+8M Staten Island, New York", + + // Multiple contact channels + "website": "http://kimsislandsi.com/", + "phone": "(718) 356-5168", + "phoneUnformatted": "+17183565168", + "email": "info@kimsislandsi.com", // From website enrichment + + // Business qualification data + "yearsInBusiness": 12, + "claimThisBusiness": false, // Verified listing + "popular": true, + "temporarilyClosed": false, + + // Precise location for territory planning + "location": { + "lat": 40.5107736, + "lng": -74.2482624 + }, + + // Operational insights for scheduling outreach + "openingHours": { + "Monday": "11:00 AM - 10:00 PM", + "Tuesday": "11:00 AM - 10:00 PM", + "Wednesday": "11:00 AM - 10:00 PM", + "Thursday": "11:00 AM - 10:00 PM", + "Friday": "11:00 AM - 11:00 PM", + "Saturday": "11:00 AM - 11:00 PM", + "Sunday": "12:00 PM - 9:30 PM" + } +} +``` + +### Search with Search Terms Module + +The Search Terms module is a component of the Google Maps Leads Scraper designed to discover and extract business leads by using specific search queries, similar to how you'd search on Google Maps directly. + +#### Key Features + +- _Keyword-Based Discovery_: Find businesses using the same search terms you'd enter in Google Maps +- _Location Targeting_: Define your target market using simple location queries (city + country format) +- _Customizable Result Limit_: Control exactly how many leads to extract per search term +- _Language Selection_: View business information in your preferred language +- _Quality Filters_: Focus on high-quality leads by setting minimum star ratings +- _Website Availability Filter_: Target only businesses with (or without) websites +- _Exact Name Matching_: Find businesses with exact or partial name matches +- _Operational Status Filter_: Exclude temporarily or permanently closed businesses + +#### How It Works + +This module allows you to enter search terms that match what you would typically type into the Google Maps search bar. You can search for general business types (like "coffee shop"), specific services ("dog grooming"), or product offerings ("organic produce"). + +The search results can be further refined using optional category filters, which help ensure you're capturing precisely the type of businesses you're targeting. For maximum efficiency, you can combine broader search terms with strategic category filters to capture the most relevant leads without excluding valuable prospects. + +### Advanced and Custom Search Module - Google Maps Leads Scraper + +The Advanced and Custom Search module is the most powerful component of the Google Maps Leads Scraper, designed for sophisticated lead generation campaigns that require precise geographic targeting and advanced search capabilities. This module gives you complete control over your lead discovery process with multiple location definition methods and advanced filtering options. + +#### Key Features + +- _Multiple Location Definition Methods_: Define target areas using free-text location queries, country/state/city selections, postal codes, or custom polygon coordinates +- _Custom Geographic Targeting_: Draw precise search areas using longitude/latitude coordinates for highly targeted campaigns +- _Direct URL Importing_: Extract leads from specific Google Maps search URLs, CID links, or shortened map links +- _Keyword-Based Discovery_: Find businesses using search terms, just like in Google Maps +- _Category Filtering_: Further refine results with optional category filters +- _Comprehensive Lead Filtering_: Apply multiple quality filters simultaneously for precise lead targeting + +#### How It Works + +This module provides the most flexible options for defining where and how to search for business leads: + +### Geographic Targeting Options + +- _Simple Location Query_: Use natural language location inputs like "New York, USA" +- _Structured Location Components_: Build precise locations using country, state, city, or county parameters +- _Postal Code Targeting_: Target specific postal/ZIP code areas for direct mail campaigns +- _Custom Polygon Areas_: Define exact geographic boundaries using coordinate pairs for ultra-precise targeting + +### Search and Filter Capabilities + +- _Keyword-Based Search_: Discover businesses using industry, service, or product terms +- _Category-Based Filtering_: Apply Google's category system to refine results +- _Quality Filters_: Target businesses with specific ratings, website presence, and operational status + +```json title="Advances output data, shortened sample" +{ + "searchString": "coffee shop", + "rank": 9, + "searchPageUrl": "https://www.google.com/maps/search/coffee%20shop/@40.748508724216016,-74.0186770781978,17z?hl=en", + "searchPageLoadedUrl": "https://www.google.com/maps/search/coffee%20shop/@40.748508724216016,-74.0186770781978,17z?hl=en", + "isAdvertisement": false, + "title": "Bluestone Lane Chelsea Piers Café", + "price": "$20–30", + "categoryName": "Coffee shop", + + // Address and location data + "address": "62 Chelsea Piers Pier 62, New York, NY 10011", + "neighborhood": "Manhattan", + "street": "62 Chelsea Piers Pier 62", + "city": "New York", + "postalCode": "10011", + "state": "New York", + "countryCode": "US", + "location": { + "lat": 40.7485378, + "lng": -74.0087457 + }, + "plusCode": "GQ62+8M Staten Island, New York", + + // Contact information + "website": "https://bluestonelane.com/?y_source=1_MjMwNjk1NDAtNzE1LWxvY2F0aW9uLndlYnNpdGU%3D", + "phone": "(718) 374-6858", + "phoneUnformatted": "+17183746858", + + // Rating and reviews + "totalScore": 4.3, + "reviewsCount": 425, + "imagesCount": 659, + + // Business identifiers + "claimThisBusiness": false, + "permanentlyClosed": false, + "temporarilyClosed": false, + "placeId": "ChIJDTUgz1dZwokRtsQ97Tbf0cA", + "categories": ["Coffee shop", "Cafe"], + "fid": "0x89c25957cf20350d:0xc0d1df36ed3dc4b6", + "cid": "13894131752416167094", + + // Operating hours + "openingHours": [ + {"day": "Monday", "hours": "7 AM to 6 PM"}, + {"day": "Tuesday", "hours": "7 AM to 6 PM"}, + {"day": "Wednesday", "hours": "7 AM to 6 PM"}, + {"day": "Thursday", "hours": "7 AM to 6 PM"}, + {"day": "Friday", "hours": "7 AM to 6 PM"}, + {"day": "Saturday", "hours": "7 AM to 6 PM"}, + {"day": "Sunday", "hours": "7 AM to 6 PM"} + ], + + // Business attributes and amenities + "additionalInfo": { + "Service options": [ + {"Outdoor seating": true}, + {"Curbside pickup": true}, + {"No-contact delivery": true}, + {"Delivery": true}, + {"Onsite services": true}, + {"Takeout": true}, + {"Dine-in": true} + ], + "Highlights": [ + {"Great coffee": true}, + {"Great tea selection": true}, + {"Live music": true}, + {"Live performances": true}, + {"Rooftop seating": true} + ], + "Popular for": [ + {"Breakfast": true}, + {"Lunch": true}, + {"Solo dining": true}, + {"Good for working on laptop": true} + ], + "Accessibility": [ + {"Wheelchair accessible entrance": true}, + {"Wheelchair accessible parking lot": true}, + {"Wheelchair accessible restroom": true}, + {"Wheelchair accessible seating": true} + ], + "Offerings": [ + {"Coffee": true}, + {"Comfort food": true}, + {"Organic dishes": true}, + {"Prepared foods": true}, + {"Quick bite": true}, + {"Small plates": true}, + {"Vegetarian options": true} + ], + "Dining options": [ + {"Breakfast": true}, + {"Brunch": true}, + {"Lunch": true}, + {"Catering": true}, + {"Dessert": true}, + {"Seating": true} + ], + "Amenities": [ + {"Restroom": true}, + {"Wi-Fi": true}, + {"Free Wi-Fi": true} + ], + "Atmosphere": [ + {"Casual": true}, + {"Cozy": true}, + {"Trendy": true} + ], + "Crowd": [ + {"Family-friendly": true}, + {"LGBTQ+ friendly": true}, + {"Transgender safespace": true} + ], + "Planning": [ + {"Accepts reservations": true} + ], + "Payments": [ + {"Credit cards": true}, + {"Debit cards": true}, + {"NFC mobile payments": true} + ], + "Children": [ + {"Good for kids": true}, + {"High chairs": true} + ] + }, + + // Image and metadata + "imageUrl": "https://lh3.googleusercontent.com/p/AF1QipMl6-SnuqYEeE3mD54M0q5D5nysRUZQj1BB0g8=w408-h272-k-no", + "kgmid": "/g/11ph8zh6sg", + "url": "https://www.google.com/maps/search/?api=1&query=Bluestone%20Lane%20Chelsea%20Piers%20Caf%C3%A9&query_place_id=ChIJDTUgz1dZwokRtsQ97Tbf0cA", + "scrapedAt": "2025-04-22T14:23:34.961Z" +} +``` + +## Best Practices + +1. _Choose the right location method_ for your campaign: + - Free-text location queries for quick, general area targeting + - Country/State/City combinations for administrative boundary targeting + - Postal codes for direct mail campaign areas + - Custom polygons for precise neighborhood or business district targeting +2. _Layer search parameters effectively_: + - Start with broader geographic targeting + - Apply search terms to identify relevant business types + - Use category filters to further refine results + - Apply quality filters (ratings, website presence) as the final step +3. _Consider URL-based extraction_ for specific scenarios: + - When you have existing Google Maps searches with desired filters + - For capturing specific business types Google has already grouped + - When working with curated Google Maps lists +4. _Optimize polygon definitions_ for complex areas: + - Use 4-8 coordinate pairs for most areas + - Ensure coordinates form a closed shape + - Test with smaller areas before scaling to large regions + +## Advanced Features + +- _Multi-Location Campaigns_: Configure separate runs for each territory and combine results +- _Direct Place ID Targeting_: Extract data from specific businesses using place IDs +- _Custom Boundary Definitions_: Use longitude/latitude coordinates to define precise areas like neighborhoods, business districts, or sales territories +- _URL Parameter Extraction_: Capture lead data from complex Google Maps search URLs with multiple parameters + +## Important Notes + +- Different location methods should not be combined (use either free-text location OR country/state/city parameters) +- Custom polygon areas take precedence over other location methods when defined +- Always verify location coverage before running large-scale extractions +- Direct URL imports are limited to approximately 300 results per URL +- For complex geographic areas, breaking into multiple targeted searches yields better results + +There are other native Make Apps powered by Apify. You can check out Apify Scraper for: + +- [Instagram Data](/platform/integrations/make/instagram) +- [TikTok](/platform/integrations/make/tiktok) +- [Google Search](/platform/integrations/make/search) +- [YouTube Data](/platform/integrations/make/youtube) +- [AI crawling](/platform/integrations/make/ai-crawling) +- [Amazon](/platform/integrations/make/amazon) + +And more! Because you can access any of our 4,500+ scrapers on Apify Store by using the [general Apify connections](https://www.make.com/en/integrations/apify). diff --git a/sources/platform/integrations/workflows-and-notifications/make/search.md b/sources/platform/integrations/workflows-and-notifications/make/search.md new file mode 100644 index 0000000000..14c66453c5 --- /dev/null +++ b/sources/platform/integrations/workflows-and-notifications/make/search.md @@ -0,0 +1,125 @@ +--- +title: Make - Google Search Actor integration +description: Learn about Google Search scraper modules. +sidebar_label: Google Search +sidebar_position: 3 +slug: /integrations/make/search +--- + +## Apify Scraper for Google Search + +The Google search modules from [Apify](https://apify.com) allows you to crawl Google Search Results Pages (SERPs) and extract data from those web pages in structured format such as JSON, XML, CSV, or Excel. + +To use the module, you need an [Apify account](https://console.apify.com) and an [API token](https://docs.apify.com/platform/integrations/api#api-token), which you can find in the Apify Console under **Settings > Integrations**. After connecting, you can automate data extraction and incorporate the results into your workflows. + +## Connect Apify Scraper for Google Search modules to Make + +1. Create an account at [Apify](https://console.apify.com/). You can sign up using your email, Gmail, or GitHub account. + +![Sign up page](images/search/search-signup.png) + +1. To connect your Apify account to Make, you can use an OAuth connection (recommended) or an Apify API token. To get the Apify API token, navigate to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)** in the Apify Console. + +![Apify Console token for Make.png](images/Apify_Console_token_for_Make.png) + +1. Find your token under **Personal API tokens** section. You can also create a new API token with multiple customizable permissions by clicking on **+ Create a new token**. +1. Click the **Copy** icon next to your API token to copy it to your clipboard. Then, return to your Make scenario interface. + + ![Apify token on Make.png](images/Apify_token_on_Make.png) + +1. On Make, click **Add** to open the **Create a connection** dialog of the chosen Apify Scraper module. +1. In the **API token** field, paste the API token you copied from Apify. Provide a clear **Connection name**, and click **Save**. + +![Make API token](images/search/image%201.png) + +Once connected, you can build workflows to automate Google Search extraction and integrate results into your applications. + +## Apify Scraper for Google Search Data modules + +After connecting the app, you can use one of the primary modules as native scrapers to extract public Google Search data: + +### Extract Google Search Results + +Get comprehensive search results via [Apify’s Google Search Scraper](https://apify.com/apify/google-search-scraper). Enter your search terms or Google Search URLs, one per line. + +For each Google Search query, you will extract: + +- _Organic results_: comprehensive listings with titles, descriptions, URLs, and position data. +- _Paid results_: sponsored listings and advertisements that appear in search results. +- _AI Overviews_: Google’s AI-generated summaries that appear at the top of results. +- _People Also Ask_: related questions and their expandable answers. +- _Related queries_: suggested search terms related to your original query. +- _Featured snippets_: highlighted content that directly answers search queries. +- _Additional data_: prices, review ratings, product information, and more where available. + +```json title="Search results data, shortened sample" +{ + "searchQuery": { + "term": "javascript", + "page": 1, + "type": "SEARCH", + "countryCode": "us", + "languageCode": "en", + "locationUule": null, + "device": "DESKTOP" + }, + "url": "https://www.google.com/search?q=javascript&hl=en&gl=us&num=10", + "hasNextPage": true, + "resultsCount": 13600000000, + "organicResults": [ + { + "title": "JavaScript Tutorial", + "url": "https://www.w3schools.com/js/", + "displayedUrl": "https://www.w3schools.com › js", + "description": "JavaScript is the world's most popular programming language. JavaScript is the programming language of the Web. JavaScript is easy to learn.", + "position": 1, + "emphasizedKeywords": ["JavaScript", "JavaScript", "JavaScript", "JavaScript"], + "siteLinks": [] + } + ], + "paidResults": [ + { + "title": "JavaScript Online Course - Start Learning JavaScript", + "url": "https://www.example-ad.com/javascript", + "displayedUrl": "https://www.example-ad.com", + "description": "Learn JavaScript from scratch with our comprehensive online course. Start your coding journey today!", + "position": 1, + "type": "SHOPPING" + } + ], + "peopleAlsoAsk": [ + { + "question": "What is JavaScript used for?", + "answer": "JavaScript is used for creating interactive elements on websites, browser games, frontend of web applications, mobile applications, and server applications...", + "url": "https://www.example.com/javascript-uses" + } + ] +} +``` + +#### Advanced Search Capabilities + +Customize your searches with powerful filtering options: + +- _Regional targeting_: Select specific countries and languages for localized results +- _Device simulation_: Get results as they would appear on desktop or mobile devices +- _Site filtering_: Restrict results to specific domains with `site:example.com` +- _Exclusion operators_: Remove unwanted sources with `site:reddit.com` +- _Exact phrase matching_: Search for precise phrases with quotation marks +- _Date filtering_: Limit results to specific time periods +- _File type filtering_: Target specific document formats like PDF, DOC, or XLSX +- _Content location targeting_: Find keywords in specific parts of pages with `intext:`, `intitle:`, and `inurl:` +- _UULE parameters_: Target searches to exact geographic locations + +The scraper exports data in various formats including JSON, CSV, Excel, and XML, enabling integration with your workflows and applications. + +There are other native Make Apps powered by Apify. You can check out Apify Scraper for: + +- [Instagram Data](/platform/integrations/make/instagram) +- [TikTok Data](/platform/integrations/make/tiktok) +- [Google Maps Emails Data](/platform/integrations/make/maps) +- [YouTube Data](/platform/integrations/make/youtube) +- [AI crawling](/platform/integrations/make/ai-crawling) +- [Amazon Data](/platform/integrations/make/amazon) + +And more! Because you can access any of our 4,500+ scrapers on Apify Store by using the [general Apify connections](https://www.make.com/en/integrations/apify). diff --git a/sources/platform/integrations/workflows-and-notifications/make/tiktok.md b/sources/platform/integrations/workflows-and-notifications/make/tiktok.md new file mode 100644 index 0000000000..9419ed2eb6 --- /dev/null +++ b/sources/platform/integrations/workflows-and-notifications/make/tiktok.md @@ -0,0 +1,174 @@ +--- +title: Make - TikTok Actor integration +description: Learn about TikTok scraper modules, extract posts, comments, and profile data. +sidebar_label: TikTok +sidebar_position: 2 +slug: /integrations/make/tiktok +--- + +## Apify Scraper for TikTok Data + +The TikTok Scraper modules from [Apify](https://apify.com) allow you to extract hashtag, comments, and profile data from TikTok. + +To use these modules, you need an [Apify account](https://console.apify.com) and an [API token](https://docs.apify.com/platform/integrations/api#api-token). You can find your token in the [Apify Console](https://console.apify.com/) under **Settings > Integrations**. After connecting, you can automate data extraction and incorporate the results into your workflows. + +## Connect Apify Scraper for TikTok Data modules to Make + +1. Create an account at [Apify](https://console.apify.com/). You can sign up using your email, Gmail, or GitHub account. + + ![Sign up page](images/tiktok/image.png) + +1. To connect your Apify account to Make, you can use an OAuth connection (recommended) or an Apify API token. To get the Apify API token, navigate to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)** in the Apify Console. + + ![Apify Console token for Make.png](images/Apify_Console_token_for_Make.png) + +1. Find your token under **Personal API tokens** section. You can also create a new API token with multiple customizable permissions by clicking on **+ Create a new token**. +1. Click the **Copy** icon next to your API token to copy it to your clipboard. Then, return to your Make scenario interface. + + ![Apify token on Make.png](images/Apify_token_on_Make.png) + +1. In Make, click **Add** to open the **Create a connection** dialog of the chosen Apify Scraper module. +1. In the **API token** field, paste the API token you copied from Apify. Provide a clear **Connection name**, and click **Save**. + + ![Apify Token for modules on Make.png](images/tiktok/image1.png) + +Once connected, you can build workflows to automate TikTok data extraction and integrate results into your applications. + +## Apify Scraper for TikTok Data modules + +After connecting the app, you can use one of the three existing Search modules as native scrapers to extract public TikTok data: + +### Extract TikTok profiles + +Get profile details via [Apify's TikTok Profile Scraper](https://apify.com/clockworks/tiktok-profile-scraper). To use this module, fill in the profile names you want to gather information about. + +For each TikTok profile, you will extract: + +- _Basic profile details_: name, nickname, bio, ID, and profile URL. +- _Account status_: whether the account is verified or not, and if it's a business and seller account. +- _Follower and engagement metrics_: number of followers and accounts followed. +- _Profile avatar_: avatar URLs. +- _Content information_: number of videos, fans, hearts, friends, and likes. + +```json title="Profile data, shortened sample" +[ + { + "authorMeta": { + "id": "6987048613642159109", + "name": "nasaofficial", + "profileUrl": "https://www.tiktok.com/@nasaofficial", + "nickName": "NASA", + "verified": false, + "signature": "National Aeronautics Space Association", + "bioLink": null, + "originalAvatarUrl": "https://p16-sign-va.tiktokcdn.com/tos-maliva-avt-0068/6f0cf6a7e7d410e3a624f0af8fa4d314~tplv-tiktokx-cropcenter:720:720.jpeg?dr=10399&nonce=84125&refresh_token=05118aa7a7b44a43f792d1a09d7bfecf&x-expires=1740060000&x-signature=NKl%2Fc2Ma6bNAhN2pHpCRWflSejQ%3D&idc=no1a&ps=13740610&shcp=81f88b70&shp=a5d48078&t=4d5b0474", + "avatar": "https://p16-sign-va.tiktokcdn.com/tos-maliva-avt-0068/6f0cf6a7e7d410e3a624f0af8fa4d314~tplv-tiktokx-cropcenter:720:720.jpeg?dr=10399&nonce=84125&refresh_token=05118aa7a7b44a43f792d1a09d7bfecf&x-expires=1740060000&x-signature=NKl%2Fc2Ma6bNAhN2pHpCRWflSejQ%3D&idc=no1a&ps=13740610&shcp=81f88b70&shp=a5d48078&t=4d5b0474", + "commerceUserInfo": { + "commerceUser": true, + "category": "Education & Training", + "categoryButton": false + }, + "privateAccount": false, + "region": "US", + "roomId": "", + "ttSeller": false, + "following": 4, + "friends": 0, + "fans": 2049, + "heart": 135, + "video": 0, + "digg": 0 + }, + "input": "https://www.tiktok.com/@nasaofficial", + } +] +``` + +### Extract TikTok comments + +Retrieve comments from videos by calling [Apify's TikTok Comments Scraper](https://apify.com/clockworks/tiktok-comments-scraper). To set up this module, you will need to add TikTok video URLs to extract the comments from, the desired number of comments, and optionally, the maximum number of replies per comment. + +For each TikTok video, you will extract: + +- _Comment details_: comment text, timestamp, and number of likes. +- _Commenter profile_: username, ID, and avatar URL. +- _Engagement data_: number of replies. +- _Post association_: URL of the TikTok video the comment belongs to. + +```json title="Comment data, shortened sample" +[ + { + "text": "Free lunches??!!!", + "diggCount": 1, + "replyCommentTotal": 1, + "createTimeISO": "2024-02-21T16:10:50.000Z", + "uniqueId": "abdmohimnhareth99", + "videoWebUrl": "https://www.tiktok.com/@apifyoffice/video/7338085038258457889", + "uid": "7114813797776491525", + "cid": "7338088354673640225", + "avatarThumbnail": "https://p77-sign-va.tiktokcdn.com/tos-maliva-avt-0068/e678ece1460eac51f1c4ed95db9a8e31~tplv-tiktokx-cropcenter:100:100.jpg?dr=10399&nonce=21560&refresh_token=3d45927e8ec8daaf4c27956e2fdaa849&x-expires=1739973600&x-signature=aFYfAqAMHdHdad9pNzOgThjcgds%3D&idc=no1a&ps=13740610&shcp=ff37627b&shp=30310797&t=4d5b0474" + }, + { + "text": "Every day🤭", + "diggCount": 0, + "replyCommentTotal": null, + "createTimeISO": "2024-02-21T16:24:09.000Z", + "uniqueId": "apifyoffice", + "videoWebUrl": "https://www.tiktok.com/@apifyoffice/video/7338085038258457889", + "uid": "7095709566285480965", + "cid": "7338091744464978720", + "avatarThumbnail": "https://p16-sign-useast2a.tiktokcdn.com/tos-useast2a-avt-0068-euttp/2c511269b14f70cca0c11c3285ddc668~tplv-tiktokx-cropcenter:100:100.jpg?dr=10399&nonce=11659&refresh_token=c2a577eebaa68fc73aac11e9b99fefcb&x-expires=1739973600&x-signature=LUTudhynytGwrfL9MKFHKO8v7EA%3D&idc=no1a&ps=13740610&shcp=ff37627b&shp=30310797&t=4d5b0474" + }, + ] +``` + +### Extract TikTok hashtags + +Gather post data with [Apify's TikTok Hashtag Scraper](https://apify.com/clockworks/tiktok-hashtag-scraper). To set up this module, you will need to add the TikTok hashtags from which you want to extract videos and the desired number of videos per hashtag. + +For each TikTok hashtag, you will extract: + +- _All TikToks posted with chosen hashtags_: caption, video URL, number of plays, hearts, comments, shares, country of creation, timestamp, paid status, video and music metadata. +- _Basic creator info from TikToks posted with chosen hashtags_: name, ID, avatar, bio, account status, total followers/following numbers, given/received likes count, etc. +- _Total number of views for a chosen hashtag_ + +```json title="Hashtag data, shortened sample" +[ + { + "videoMeta.coverUrl": "https://p77-sign-va.tiktokcdn.com/obj/tos-maliva-p-0068/1824f891fd0e48e7bf46513f27383e20_1727638068?lk3s=b59d6b55&x-expires=1740060000&x-signature=PNotHaeJ5nqiyt6zbbZqi4RljzA%3D&shp=b59d6b55&shcp=-", + "text": "y como es tu hijo?🥰#trendslab #CapCut #hijo #bebe #capcutamor #amordemivida #parati ", + "diggCount": 56500, + "shareCount": 5968, + "playCount": 5500000, + "commentCount": 0, + "videoMeta.duration": 9, + "isAd": false, + "isMuted": false, + "hashtags": [ + { + "id": "1662966768289798", + "name": "trendslab", + "title": "", + "cover": "" + }, + { + "id": "1663935709411330", + "name": "capcut", + "title": "CapCut is a new, easy-to-use video editing tool designed for mobile platforms. CapCut provides users with a wide range of video editing functions, filters, audio & visual effects, video templates, while keeping it free of charge and ads-free. Everyone can be a creator by using CapCut. \n\nStart creating your cool videos today: \nhttps://capcut.onelink.me/XKqI/228cad85", + "cover": "" + }, +] +``` + +## Other scrapers available + +There are other native Make Apps powered by Apify. You can check out Apify Scraper for: + +- [Instagram Data](/platform/integrations/make/instagram) +- [Google Search](/platform/integrations/make/search) +- [Google Maps Emails Data](/platform/integrations/make/maps) +- [YouTube Data](/platform/integrations/make/youtube) +- [AI crawling](/platform/integrations/make/ai-crawling) +- [Amazon](/platform/integrations/make/amazon) + +And more! Because you can access any of our 4,500+ scrapers on Apify Store by using the [general Apify connections](https://www.make.com/en/integrations/apify). diff --git a/sources/platform/integrations/workflows-and-notifications/make/youtube.md b/sources/platform/integrations/workflows-and-notifications/make/youtube.md new file mode 100644 index 0000000000..1dde0b3bd4 --- /dev/null +++ b/sources/platform/integrations/workflows-and-notifications/make/youtube.md @@ -0,0 +1,231 @@ +--- +title: Make - YouTube Actor integration +description: Learn about YouTube scraper modules. Extract channel, video, streams, shorts, and search data from YouTube. +sidebar_label: YouTube +sidebar_position: 5 +slug: /integrations/make/youtube +--- + +## Apify Scraper for YouTube Data + +The YouTube Scraper module from [apify.com](https://apify.com) allows you to extract channel, video, streams, shorts, and search data from YouTube. + +To use this module, you need an [Apify account](https://console.apify.com) and an [API token](https://docs.apify.com/platform/integrations/api#api-token), which you can find in the Apify Console under **Settings > Integrations**. After connecting, you can automate data extraction and incorporate the results into your workflows. + +For more details, follow the tutorial below. + +## Connect Apify Scraper for YouTube Data modules to Make + +1. Create an account at [Apify](https://console.apify.com/). You can sign up using your email, Gmail, or GitHub account. + + ![Sign up page](images/youtube/image.png) + +1. To connect your Apify account to Make, you can use an OAuth connection (recommended) or an Apify API token. To get the Apify API token, navigate to **[Settings > API & Integrations](https://console.apify.com/settings/integrations)** in the Apify Console. + + ![Apify Console token for Make.png](images/Apify_Console_token_for_Make.png) + +1. Find your token under **Personal API tokens** section. You can also create a new API token with multiple customizable permissions by clicking on **+ Create a new token**. +1. Click the **Copy** icon next to your API token to copy it to your clipboard. Then, return to your Make scenario interface. + + ![Apify token on Make.png](images/Apify_token_on_Make.png) + +1. In Make, click **Add** to open the **Create a connection** dialog of the chosen Apify Scraper module. +1. In the **API token** field, paste the API token you copied from Apify. Provide a clear **Connection name**, and click **Save**. + + ![Make API token](images/youtube/image1.png) + +Once connected, you can build workflows to automate YouTube data extraction and integrate results into your applications. + +## Apify Scraper for YouTube Data module + +After connecting the app, you can use the Search module as a native scraper to extract public YouTube data. Here’s what you get: + +### Extract YouTube data + +Get data via [Apify's YouTube Scraper](https://apify.com/streamers/youtube-scraper). To do so, simply fill in the URLs of videos, streams, shorts, searches, or channels you want to gather information about. + +For YouTube URLs, you can extract: + +- _Basic channel details_: name, number of subscribers, total videos, location, social media links +- _Video and search details_: author name, number of likes, comments, views, title, URL, subtitles, duration, release date + +```json title="Channel data sample" +{ + "id": "HV6OlMPn5sI", + "title": "Raimu - The Spirit Within 🍃 [lofi hip hop/relaxing beats]", + "duration": "29:54", + "channelName": "Lofi Girl", + "channelUrl": "https://www.youtube.com/channel/UCSJ4gkVC6NrvII8umztf0Ow", + "date": "10 months ago", + "url": "https://www.youtube.com/watch?v=HV6OlMPn5sI", + "viewCount": 410458, + "fromYTUrl": "https://www.youtube.com/@LofiGirl/videos", + "channelDescription": "\"That girl studying by the window non-stop\"\n\n🎧 | Listen on Spotify, Apple music and more\n→ https://bit.ly/lofigirl-playlists\n\n💬 | Join the Lofi Girl community \n→ https://bit.ly/lofigirl-discord\n→ https://bit.ly/lofigirl-reddit\n\n🌎 | Lofi Girl on all social media\n→ https://bit.ly/lofigirl-sociaI", + "channelDescriptionLinks": [ + { + "text": "Discord", + "url": "https://discord.com/invite/hUKvJnw" + }, + { + "text": "Tiktok", + "url": "https://www.tiktok.com/@lofigirl/" + }, + { + "text": "Instagram", + "url": "https://www.instagram.com/lofigirl/" + }, + { + "text": "Twitter", + "url": "https://twitter.com/lofigirl" + }, + { + "text": "Spotify", + "url": "https://open.spotify.com/playlist/0vvXsWCC9xrXsKd4FyS8kM" + }, + { + "text": "Apple music", + "url": "https://music.apple.com/fr/playlist/lofi-hip-hop-music-beats-to-relax-study-to/pl.u-2aoq8mqiGo7J6A0" + }, + { + "text": "Merch", + "url": "https://lofigirlshop.com/" + } + ], + "channelJoinedDate": "Mar 18, 2015", + "channelLocation": "France", + "channelTotalVideos": 409, + "channelTotalViews": "1,710,167,563", + "numberOfSubscribers": 13100000, + "isMonetized": true, + "inputChannelUrl": "https://www.youtube.com/@LofiGirl/about" +} +``` + +```json title="Video data sample" +{ + "title": "Stromae - Santé (Live From The Tonight Show Starring Jimmy Fallon)", + "id": "CW7gfrTlr0Y", + "url": "https://www.youtube.com/watch?v=CW7gfrTlr0Y", + "thumbnailUrl": "https://i.ytimg.com/vi/CW7gfrTlr0Y/maxresdefault.jpg", + "viewCount": 35582192, + "date": "2021-12-21", + "likes": 512238, + "location": null, + "channelName": "StromaeVEVO", + "channelUrl": "http://www.youtube.com/@StromaeVEVO", + "numberOfSubscribers": 6930000, + "duration": "00:03:17", + "commentsCount": 14, + "text": "Stromae - Santé (Live From The Tonight Show Starring Jimmy Fallon on NBC)\nListen to \"La solassitude\" here: https://stromae.lnk.to/la-solassitude\nOrder my new album \"Multitude\" here: https://stromae.lnk.to/multitudeID\n--\nhttps://www.stromae.com/fr/\nhttps://www.tiktok.com/@stromae\nhttps://www.facebook.com/stromae\nhttps://www.instagram.com/stromae\nhttps://twitter.com/stromae\n / @stromae \n--\nMosaert\nPaul Van Haver (Stromae) : creative direction\nCoralie Barbier : creative direction and fashion design\nLuc Van Haver : creative direction\nGaëlle Birenbaum : communication & project manager\nEvence Guinet-Dannonay : executive assistant\nGaëlle Cools : content & community manager\nRoxane Hauzeur : textile product manager\nDiego Mitrugno : office manager\n\nPartizan\nProducer : Auguste Bas\nLine Producer : Zélie Deletrain \nProduction coordinator : Lou Bardou-Jacquet \nProduction assistant : Hugo Dao\nProduction assistant : Adrien Bossa\nProduction assistant : Basile Jan\n\nDirector : Julien Soulier \n1st assistant director : Mathieu Perez \n2nd assistant director : Leila Gentet \n\nDirector of Photography : Kaname Onoyama \n1st assistant operator : Micaela albanese\n2nd assistant operator : Florian Rey \nDoP Mantee : Zhaopeng Zhong\nMaking of : Adryen Barreyat\n\nHead Gaffer : Sophie Delorme \nElectrician : Sacha Brauman\nElectrician: Tom Devianne\nLighting designer : Aurélien Dayot\nPrelight electrician : Emmanuel Malherbe\n\nHead Grip : Dioclès Desrieux \nBest Boy grip : Eloi Perrin \nPrelight Grip : Vladimir Duranovic \n\nLocation manager : Léo Rodriguez \nLocation manager assistant : Grégoire Décatoire \nLocation manager assistant : Mathieu Barazer \n\nStylist : Sandra Gonzalez \nStylist assistant : Sarah Bernard\n\nMake Up and Hair Artist : Camille Roche \nMake up Artist : Carla Lange \nMake Up and Hair Artist : Victoria Pinto \n\nSound Engineer : Lionel Capouillez \nBackliner : Nicolas Fradet \n\nProduction Designer : Penelope Hemon \n\nChoreographer : Marion Motin \nChoreographer assistant : Jeanne Michel \n\nPost production : Royal Post\nPost-Production Director : Cindy Durand Paucsik\nEditor : Marco Novoa\nEditor assistant : Térence Nury \nGrader : Vincent Amor\nVFX Supervisor : Julien Laudicina\nGraphic designer : Quentin Mesureux \nGraphic designer : Lucas Ponçon \nFilm Lab Assistant : Hadrian Kalmbach\n\nMusicians:\nFlorian Rossi \nManoli Avgoustinatos\nSimon Schoovaerts \nYoshi Masuda \n\nDancers: \nJuliana Casas\nLydie Alberto \nRobinson Cassarino\nYohann Hebi daher\nChris Fargeot \nAudrey Hurtis \nElodie Hilsum\nDaya jones \nThéophile Bensusan \nBrandon Masele \nJean Michel Premier \nKevin Bago\nAchraf Bouzefour\nPauline Journe \nCaroline Bouquet \nManon Bouquet\nAshley Biscette \nJocelyn Laurent \nOumrata Konan\nKylian Toto\nEnzo Lesne \nSalomon Mpondo-Dicka\nSandrine Monar \nKarl-Ruben Noel\n\n#Stromae #Sante #JimmyFallon", + "descriptionLinks": [ + { + "url": "https://stromae.lnk.to/la-solassitude", + "text": "https://stromae.lnk.to/la-solassitude" + }, + { + "url": "https://stromae.lnk.to/multitudeID", + "text": "https://stromae.lnk.to/multitudeID" + }, + { + "url": "https://www.stromae.com/fr/", + "text": "https://www.stromae.com/fr/" + }, + { + "url": "https://www.tiktok.com/@stromae", + "text": "https://www.tiktok.com/@stromae" + }, + { + "url": "https://www.facebook.com/stromae", + "text": "https://www.facebook.com/stromae" + }, + { + "url": "https://www.instagram.com/stromae", + "text": "https://www.instagram.com/stromae" + }, + { + "url": "https://twitter.com/stromae", + "text": "https://twitter.com/stromae" + }, + { + "url": "https://www.youtube.com/channel/UCXF0YCBWewAj3RytJUAivGA", + "text": " / @stromae " + }, + { + "url": "https://www.youtube.com/hashtag/stromae", + "text": "#Stromae" + }, + { + "url": "https://www.youtube.com/hashtag/sante", + "text": "#Sante" + }, + { + "url": "https://www.youtube.com/hashtag/jimmyfallon", + "text": "#JimmyFallon" + } + ], + "subtitles": null, + "comments": null, + "isMonetized": true, + "commentsTurnedOff": false +} +``` + +```json title="Search results data sample" +{ + "id": "CwRMBKk8St0", + "title": "LET'S ARGUE: Beyoncé Fails the Bechdel Test!", + "duration": "13:48", + "channelName": "fantano", + "channelUrl": "https://www.youtube.com/@fantano", + "date": "5 years ago", + "url": "https://www.youtube.com/watch?v=CwRMBKk8St0", + "viewCount": 635379, + "fromYTUrl": "https://www.youtube.com/results?search_query=bechdel+test" +}, +{ + "id": "k86TWcdjQuM", + "title": "This scene is the anti-Bechdel test", + "duration": "1:00", + "channelName": "Newbie Star Trek", + "channelUrl": "https://www.youtube.com/@NewbieStarTrek", + "date": "2 months ago", + "url": "https://www.youtube.com/shorts/k86TWcdjQuM", + "viewCount": 6907, + "fromYTUrl": "https://www.youtube.com/results?search_query=bechdel+test" +}, +{ + "id": "vKlakrW50QU", + "title": "Inside Job passes the bechdel test", + "duration": "0:15", + "channelName": "Random Daydreamer", + "channelUrl": "https://www.youtube.com/@randomdaydreamer9970", + "date": "1 year ago", + "url": "https://www.youtube.com/watch?v=vKlakrW50QU", + "viewCount": 121824, + "fromYTUrl": "https://www.youtube.com/results?search_query=bechdel+test" +}, +{ + "id": "mL5hgNu4y3A", + "title": "Jessica Chastain Describes the Importance of the 'Bechdel Test'", + "duration": "3:05", + "channelName": "theoffcamerashow", + "channelUrl": "https://www.youtube.com/@theoffcamerashow", + "date": "2 years ago", + "url": "https://www.youtube.com/watch?v=mL5hgNu4y3A", + "viewCount": 24145, + "fromYTUrl": "https://www.youtube.com/results?search_query=bechdel+test" +} +``` + +## Other scrapers available + +There are other native Make Apps powered by Apify. You can check out Apify Scraper for: + +- [Instagram Data](/platform/integrations/make/instagram) +- [TikTok Data](/platform/integrations/make/tiktok) +- [Google Search](/platform/integrations/make/search) +- [Google Maps Emails Data](/platform/integrations/make/maps) +- [AI crawling](/platform/integrations/make/ai-crawling) +- [Amazon](/platform/integrations/make/amazon) + +And more! Because you can access any of our 4,500+ scrapers on Apify Store by using the [general Apify connections](https://www.make.com/en/integrations/apify).