Skip to content

[BUG](wildskirts): 403 Forbidden error for every URL #93

@YisusChrist

Description

@YisusChrist

Describe the bug

The website https://wildskirts.com seems to have started using Cloudflare to protect it from connections, so the scraping process fails at the very beginning when verifying if the URL is valid in the function dynamic_download:

try:
        response: ClientResponse = await session.get(album_url)
        response.raise_for_status()
    except Exception as e:
        ...

Steps to reproduce

Download the URL https://wildskirts.com/lolaandlover-videos

Expected behavior

All the media (163 videos) should be downloaded

Screenshots and recordings

{952DAE3C-EDE6-4F57-AF72-10828FD3C63B}

OS / Linux distribution

Windows 11

If using WSL on Windows, which version of WSL

None

Program version

0.1.0

Additional context

No response

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingcrawlerSite crawler

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions