[Components] scrapeless

[pipedream-component-development]

scrapeless

URLs

• https://apidocs.scrapeless.com/

Actions

submit-scrape-job

Prompt

Submit a new web scraping job with specified target URL and extraction rules. Requires URL and selector configuration.

URLs

• https://apidocs.scrapeless.com/api-11949852

get-scrape-result

Prompt

Retrieve the result of a completed scraping job. Requires scrape job ID.

URLs

• https://apidocs.scrapeless.com/api-11949853

[sergio-eliot-rodriguez]

User request

[SokolovskyiK]

Hi. @sergio-eliot-rodriguez
I was reading the Scrapeless documentation and got a bit confused about the task.

The submit-scrape-job description says:

Submit a new web scraping job with the specified target URL and extraction rules. Requires a URL and selector configuration.

Scrapeless appears to offer two APIs:

Universal Scraping API ( "actor": "unlocker.webunlocker", endpoint - unlocker/request)

Scraping API (predefined actors (e.g. "actor": "scraper.google.jobs", endpoint scraper/request)

Based on the task description — “Submit a new web scraping job with the specified target URL and extraction rules” — it seems like the Universal Scraping API would be the appropriate choice, as it allows submitting a URL along with CSS selectors. However, it returns the results immediately and does not provide a taskId.

The Scraping API, on the other hand, does return a taskId, but it appears to work only with a predefined list of actors — which often don’t even require a full URL. For example, the TEMU API uses a product ID instead.

Could someone please clarify which API is expected for this task, based on the information I’ve outlined?

[sergio-eliot-rodriguez]

Hi @SokolovskyiK
Good question, the expected API is Scraping API using endpoint endpoint scraper/request

I maybe wrong but I see it takes a URL too wrapped in an object:

Do you require the endpiont from Universal API as well?

[vunguyenhung]

Hello everyone, I have tested this PR and there're some test cases failed or needed improvement.

Please check the test report below for more information
https://vunguyenhung.notion.site/Components-scrapeless-1f8bf548bb5e81908ef0e748da541f7e