Skip to content

Cloudflare captcha avoids from executing #2

@sergioframi

Description

@sergioframi

Hello!
It seems that cloudflare is detecting the bot and preventing it from working correctly. I''ve tried running it from a Debian VPS and obtained the following:

python3.9 namescraper.py --headless --query domain.com --output output.txt --sessionfile session.txt securitytrails [+] Selected module: "SecurityTrails" [+] Saving results to file "output.txt" [+] Looking up "capitalone.com" (subdomains) Traceback (most recent call last): File "/home/user/tools/NameScraper/namescraper.py", line 111, in <module> scraper.lookup(query, lookup_type=lookup) File "/home/user/tools/NameScraper/scrapers/securitytrails.py", line 194, in lookup return scraper(domain) File "/home/user/tools/NameScraper/scrapers/securitytrails.py", line 190, in generic_domain_scraper return self.__selenium_scraper_domains(domain, lookup_type) File "/home/user/tools/NameScraper/scrapers/securitytrails.py", line 64, in __selenium_scraper_domains sample = self.wait.until( File "/usr/local/lib/python3.9/dist-packages/selenium/webdriver/support/wait.py", line 105, in until raise TimeoutException(message, screen, stacktrace) selenium.common.exceptions.TimeoutException: Message:

While using without --headless, I've been able to see that cloudflare captcha is stoping the bot.
Is there anything possible to make it work??

Thanks a lot!!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions