Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/styles/config/vocabularies/Docs/accept.txt
Original file line number Diff line number Diff line change
Expand Up @@ -118,7 +118,7 @@ SKUs?
subreddits?
[Ss]ubwoofer
Tripadvisor
upvote
[Uu]pvote
[Ww]alkthroughs?

ul
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
label: How to pick an Actor idea
position: 2
172 changes: 172 additions & 0 deletions sources/academy/build-and-publish/actor-ideas/actor_validation.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,172 @@
---
title: Validate your Actor idea
description: Learn how to validate market demand for your Actor using SEO data, community research, and competitive analysis before you build.
sidebar_position: 2
category: build-and-publish
slug: /build-and-publish/actor-ideas/actor-validation
---

Before investing time into building an Actor, validate that people actually need it. This guide shows you how to assess market demand using free tools and research techniques.

## Assess your motivation

Ask yourself: _Do you want to build this?_

You'll work on this Actor for a long time. The best Actors come from developers who genuinely care about the problem they're solving. You don't need to be obsessed, but you should feel excited. That enthusiasm carries you through challenges and shows
in your work.

## Estimate demand with SEO data

Check if people are searching for solutions like yours. If your idea aligns with popular search queries, you have a built-in user base.

### Keyword demand

Search for terms related to your Actor's function. If you're building a Reddit sentiment analysis scraper, check volume for phrases like _Reddit data extractor_ or _analyze Reddit comments tool_.

Use free tools:

- [Google Keyword Planner](https://business.google.com/en-all/ad-tools/keyword-planner/)
- [Whatsmyserp](https://chromewebstore.google.com/detail/whatsmyserp/chbmoagfhnkggnhbjpoonnmhnpjdjdod) Chrome extension
- [Keywords Everywhere](https://keywordseverywhere.com/) (paid)

High search volume or multiple related terms indicate solid demand. Low or zero searches mean a very niche market, which isn't bad, but you'll rely more on direct marketing.

### Google autocomplete and related searches

Type your core keywords into Google and note the suggestions. Typing _scrape Amazon_ might show _scrape Amazon reviews_ or _Amazon price tracker_, confirming what people actually want.

### SEO difficulty and content gaps

Examine current search results. Few quality results for a query like _download data from [obscure site]_ indicates a content gap your Actor can fill.

Many results or ads for _Instagram scraper_ means the market is proven but competitive. You'll need to differentiate.

Check keyword difficulty and domain authority. If difficulty is 70+ and top pages have 80+ domain authority with thousands of backlinks—and Apify already has an official Actor with 100,000+ users—you can't compete directly. Find an adjacent angle or specialization.

## Analyze Google Trends

Google Trends shows if interest in your idea is rising or falling. Declining trends are red flags. If searches dropped 90% over 12+ months (like _Clubhouse scraper_ since 2021), that market has moved on.

Growth velocity matters more than current volume. A keyword growing from 10 to 100 monthly searches over 12 months shows exploding demand. Jump in early, before competition heats up.

Watch for spikes. Sudden jumps from media coverage or viral moments usually don't mean sustainable demand.

## Research community discussions

Beyond SEO data, go where your potential users are. Browse Reddit, Hacker News, Stack Overflow, X (Twitter), Discord, and Facebook groups. What problems are people discussing? What tools do they wish existed?

Document your findings. Note quotes and recurring themes like _Multiple marketers on Reddit want easy competitor pricing tracking—no existing solution mentioned_. These insights complement your SEO data and help you speak your users' language.

Zero discussion across multiple platforms over 4+ weeks means either no one cares about the problem or they've already solved it.

### Reddit

Search relevant subreddits (r/webscraping, r/datascience, r/SEO, r/marketing, or industry-specific ones) for questions like _How can I extract [data] from [site]?_ or _I wish there was a tool to do X_. Multiple people independently asking for the same solution is strong validation.

Use the `site:` parameter in Google to search for relevant threads:

```text

site:reddit.com extracting data from LinkedIn

```

You can also use tools like [F5Bot](https://f5bot.com/) or
[GummySearch](https://gummysearch.com/).

### Q&A forums and Stack Overflow

Look for questions about doing the task manually. If thinking about a LinkedIn scraper, check Stack Overflow for questions like _How can I scrape LinkedIn profiles?_ Frequent questions or upvotes indicate many people trying to solve it without a good tool—an opportunity for your Actor.

Use the `site:` parameter:

```text

site:stackoverflow.com extracting data from LinkedIn

```

### X and social media

Search keywords on X, LinkedIn, or other social media for professionals asking for recommendations like _Does anyone know a tool to monitor news about [topic]?_

Run quick polls or ask your followers if they'd use a tool that does XYZ. A few positive responses validate your idea. Silence means rethink your value proposition. Engaging this way is early marketing.

Use the `site:` parameter:

```text

site:x.com extracting data from LinkedIn

```

### Hacker News and niche forums

Platforms like [Hacker News](https://news.ycombinator.com/) often have discussions on tech pain points and new tool launches. Search for keywords like _scrape Airbnb data_ to see if people have shown interest or if someone launched a similar tool and what the reaction was.

Use the `site:` parameter:

```text

site:news.ycombinator.com extracting data from LinkedIn

```

:::tip Look for spending signals

Current spending patterns are the strongest signal. When users mention "currently paying $X/month for [existing tool] but..." or "upgraded from free to paid plan because..." or specific competitor pricing, they are proven buyers.

You can also engage in communities. Answer related questions, share knowledge, build reputation. Mention your Actor idea casually where relevant: "I'm building a tool to solve exactly this, would you use it?" Track responses. Positive responses with questions about pricing or features mean genuine interest.

:::

## Analyze GitHub repositories

Star counts signal market demand. [Scrapy](https://github.com/scrapy/scrapy) has 58,000+, [Crawlee](https://github.com/apify/crawlee) has 20,000+, web scraping is validated. Use the [Star History tool](https://www.star-history.com/) to check if stars are rising (growing momentum) or flat.

Issue analysis reveals pain points your Actor could solve. High issue counts with active responses indicate healthy, used projects. Open issues with themes like _JavaScript rendering problems_ or _CAPTCHA bypass needed_ show gaps you can fill. Issues with 10+ upvotes mean multiple users face the same problem.

Fork and commit activity shows developers actively work with the technology. High fork-to-star ratios mean people are building extensions (evidence of real usage). Recent commits (within 30 days) indicate active maintenance and a healthy project. No commits for 6+ months suggests declining interest.

## Review Product Hunt launches

Study successful automation tool launches from the past 12-24 months on Product Hunt. Filter by _Browser Automation_ and _Automation tools_, then sort by upvotes. Note which taglines, value propositions, and features resonated. Products with 500+ upvotes validated something—figure out what worked.

## Research Apify Store

Apify Store shows transparent competitive intelligence most marketplaces hide. Every Actor displays monthly users, ratings, pricing, and last updates, a data goldmine for what works and what doesn't.

Search your use case or segment thoroughly. List relevant Actors with their metrics: monthly users, ratings, pricing, last update, and creator. Create a feature comparison matrix. Analyze top performers' READMEs, documentation quality, and issues.

Review competitor issues tabs closely. High-quality READMEs with examples and clear value propositions perform better in Store search. Issues reveal unresolved pain points from actual users. If competitors have 20+ open issues with repeated themes, that's your differentiation roadmap.

### Assess market saturation

- 10-30 Actors: healthy competition (market validated, you need differentiation)
- 50+ Actors: saturated (need obvious gaps)
- 1-5 Actors: blue ocean or unproven demand (validate carefully)

If the market has 50+ Actors with strong leaders (Apify-maintained with 50,000+ users) and you can't articulate clear differentiation, pivot. If you spot feature gaps or underserved niches, continue.

## Scan the broader market

Do a general Google search for tools or services that solve your problem. Your competition might not be another Actor—it could be a SaaS tool or API. If your idea is _monitor website uptime and screenshot changes_, established services probably exist.

Note direct competitors: How do they price it? What audience do they target? Are users satisfied or complaining? This validates that people pay for the service and reveals gaps you can fill.

Understanding the competition helps you refine your unique value—whether that's lower cost, better features, or targeting an underserved niche.

No existing solutions? Ask why. You might have found an untapped need, or it's a red flag (too difficult to implement, or the target website aggressively blocks scraping). Use your judgment.

## Get feedback from potential users

Reach out to people who match your target user profile. Building a real estate data Actor? Contact real estate analysts or agents (LinkedIn works well) and ask if a tool that does X would help them. Keep it informal—describe the problem you're solving and ask if they'd use or pay for it.

Direct feedback helps you:

- Validate your assumptions
- Understand pricing expectations
- Identify must-have features
- Refine your value proposition

Track responses carefully. Enthusiasm with specific questions about features or pricing indicates genuine interest. Generic "sounds interesting" responses mean keep validating.
Original file line number Diff line number Diff line change
@@ -0,0 +1,129 @@
---
title: Find ideas for your Actor
description: Discover what types of software you can build as Actors and use Apify's Ideas page to find trending projects for scrapers, integrations, and automation tools.
sidebar_position: 1
category: build-and-publish
slug: /build-and-publish/actor-ideas/find-actor-ideas
---

You want to build an Actor and publish it on Apify Store. Where should you start? See what types of software work as Actors and how to use the Apify Ideas page to find projects that users need.

---

## What can you build as an Actor

Actors are serverless cloud applications that run on the Apify platform. While most Actors are web scrapers, you can build various types of software as Actors can be anything that accepts input, performs a job, and runs in Docker.

### Web scrapers and crawlers

The most common type of Actor extracts data from websites. These Actors navigate web pages, collect information, and store structured data in datasets.

Examples:

- Site-specific scrapers ([Amazon Product Scraper](https://apify.com/junglee/amazon-crawler), [LinkedIn Profile Scraper](https://apify.com/curious_coder/linkedin-profile-scraper))
- Search engine scrapers ([Google Search Results](https://apify.com/apify/google-search-scraper), [Bing Search](https://apify.com/curious_coder/bing-search-scraper))
- Social media scrapers ([X/Twitter Scraper](https://apify.com/apidojo/twitter-scraper-lite), [Instagram Scraper](https://apify.com/apify/instagram-scraper))
- E-commerce data extractors ([Shopify Store Scraper](https://apify.com/autofacts/shopify), [eBay Price Monitor](https://apify.com/dtrungtin/ebay-items-scraper))

### SaaS API wrappers

Convert existing SaaS services into Actors to make them accessible through the Apify platform. This approach lets users integrate these services with Apify's automation ecosystem.

Example:

- [Parsera](https://apify.com/parsera-labs/parsera) wraps the Parsera.org service

### Open-source libraries

Package open-source tools as Actors to provide cloud-hosted versions that users can try without local installation. You handle no infrastructure while users cover compute costs.

Examples:

- [Monolith](https://apify.com/snshn/monolith) from the Y2Z/monolith GitHub project
- [Crawl4AI](https://apify.com/janbuchar/crawl4ai) from the unclecode/crawl4ai repository
- [Docling](https://apify.com/vancura/docling/source-code) from IBM's
docling-project

:::tip Open Source Fair Share

Open-source developers can earn income through [Apify's Open Source Fair Share program](https://apify.com/partners/open-source-fair-share).

:::

### MCP servers

Model Context Protocol (MCP) servers let AI agents interact with external tools and data sources. Converting MCP servers to Actors makes them accessible through Apify's platform.

Examples:

- [Playwright MCP](https://apify.com/jiri.spilka/playwright-mcp-server) from Microsoft's playwright-mcp
- [Browserbase MCP](https://apify.com/mcp-servers/browserbase-mcp-server) from Browserbase

### AI agents

Build Actors that use LLMs to perform complex tasks autonomously. These Actors can navigate websites, make decisions, and complete multi-step workflows.

## Use the Ideas page

The [Apify Ideas page](https://apify.com/ideas) is where users submit and explore potential projects for Actors. It serves as a collaborative space for proposing new tools and finding inspiration for web scraping and automation solutions.

### Browse and claim ideas

If you're unsure what to build next, the Ideas page shows projects the community wants.

Steps to develop an idea:

1. Browse the page: Visit [apify.com/ideas](https://apify.com/ideas) to find ideas that interest you. Look for ideas that align with your skills.

1. Select an idea: Review the details and requirements. Check the status—if it's marked **Open to develop**, you can start building.

1. Build your Actor: Develop your Actor based on the idea. You don't need to notify Apify during development.

1. Prepare for launch: Ensure your Actor meets quality standards and has a comprehensive README with installation instructions, usage details, and examples.

1. Publish your Actor: Deploy your Actor on Apify Store and make it live.

1. Claim your idea: After publishing, email [[email protected]](mailto:[email protected]) with your Actor URL and the original idea. Apify will tag the idea as _Completed_ and link it to your Actor.

1. Monitor and optimize: Track your Actor's performance and user feedback. Make improvements to keep your Actor current.

### Criteria for claiming an idea

To claim an idea, ensure:

- Your Actor is functional
- Your README contains relevant information
- Your Actor closely aligns with the original idea

### Submit your own ideas

The Ideas page is also where you contribute concepts to drive innovation in the community.

How to contribute:

1. Submit ideas: Share Actor concepts through the [Ideas submission
form](https://apify.typeform.com/to/BNON8poB#source=ideas). Provide clear details about what the tool should do and how it should work.

1. Engage with the community: Upvote ideas you find intriguing. More support
increases the likelihood a developer will build it.

1. Claim completed ideas: Once your Actor is running, claim your idea by emailing [[email protected]](mailto:[email protected]). Apify will mark it
_Completed_ and link it to your Actor—signaling to other developers that this tool exists.

### Multiple developers for one idea

Apify Store can host multiple Actors with similar functions. However, the "first come, first served" rule applies—the first developer to claim an idea receives the _Completed_ tag and a link from the Ideas page.

Competition helps developers improve their code. You can still build the Actor, but differentiate with a unique set of features.

## Generate ideas from other sources

Beyond the Ideas page, you can find Actor ideas through:

- SEO tools: Discover relevant search terms people use to find solutions
- Your experience: Draw from problems you've encountered in your work
- Community discussions: Browse Reddit, Stack Overflow, and forums for pain
points
- Competitor analysis: Research existing tools and identify gaps

For a complete validation framework, see [Validate your Actor idea](/academy/build-and-publish/actor-ideas/actor-validation).
Original file line number Diff line number Diff line change
@@ -1,20 +1,20 @@
---
title: Actor success stories
description: Learn about developers who successfully make passive income from their Actors.
sidebar_position: 5
category: apify platform
sidebar_position: 7
category: build-and-publish
slug: /actor-marketing-playbook/store-basics/actor-success-stories
---

_Web scraping freelance financial freedom with microworlds._

Discover how Caleb David, founder of `microworlds`, achieved financial freedom through freelance web scraping. His journey showcases how mastering the craft with tools like Crawlee and creating a Twitter scraper transformed his career. See the full story [here](https://blog.apify.com/web-scraping-freelance-financial-freedom/) and learn from his success.
Discover how Caleb David, founder of `microworlds`, achieved financial freedom through freelance web scraping. His journey showcases how mastering the craft with tools like Crawlee and creating a Twitter scraper transformed his career. See the full story in this [blog post](https://blog.apify.com/web-scraping-freelance-financial-freedom/) and learn from his success.

https://apify.com/microworlds

_Web scraping for freelance success – insights from Tugkan._

In this success story, our first community dev Tugkan shares how his journey into freelancing via Apify changed his life. Learn about his process, challenges, and how his paid Actors have brought him financial rewards and freedom. Check out his story [here](https://apify.com/success-stories/paid-actor-journey-apify-freelancer-tugkan) for inspiration.
In this success story, our first community dev Tugkan shares how his journey into freelancing via Apify changed his life. Learn about his process, challenges, and how his paid Actors have brought him financial rewards and freedom. Check out his [story](https://apify.com/success-stories/paid-actor-journey-apify-freelancer-tugkan) for inspiration.

https://apify.com/epctex

Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
label: Apify Store basics
position: 4
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
title: Actor description & SEO description
description: Learn about Actor description and meta description. Where to set them and best practices for both content and length.
sidebar_position: 3
category: apify platform
category: build-and-publish
slug: /actor-marketing-playbook/actor-basics/actor-description
---

Expand Down Expand Up @@ -70,7 +70,7 @@ Setting the SEO description and SEO name is optional. If not set, the descriptio

![changing actor name and seo name](images/changing_Actor_name_and_SEO_name.png)

Actor description specifically can also be quick-edited in this pop-up on the Actor's page in Apify Console. Open the **Actor's page**, then click on **…** in the top right corner, and choose ✎ **Edit name or description**. Then set the URL in the **Unique name** ✎ field and click **Save**.
Actor description specifically can also be quick-edited in this pop-up on the Actor's page in Apify Console. Open the **Actor's page**, then click on **…** in the top right corner, and choose ✎ **Edit name or description**. Then set the URL in the **Unique name** ✎ field and click **Save**.

![changing actor description](images/change_Actor_description.png)

Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
---
title: Actors & emojis
title: Actors and emojis
description: Discover how emojis can boost your Actors by grabbing attention, simplifying navigation, and enhancing clarity. Improve user experience and engagement on Apify Store.
sidebar_position: 5
category: apify platform
sidebar_position: 4
category: build-and-publish
slug: /actor-marketing-playbook/actor-basics/actors-and-emojis
---

Expand Down
Loading