Skip to content

Web scraping fails for an OpenAI documentation URL #18

@ndhoanit1112

Description

@ndhoanit1112

Web scraping fails for OpenAI documentation URL

Steps to Reproduce

from supadata import Supadata

supadata = Supadata(api_key="MY_API_KEY")

url = "https://platform.openai.com/docs/guides/image-generation"
web_content = supadata.web.scrape(url)

Expected Behavior

The scraper should successfully extract and return the content from the OpenAI documentation page.

Actual Behavior

The scraping operation fails with a keyword argument error during initialization.

Error Message

Scrape.init() got an unexpected keyword argument 'type'

SDK Version

1.3.1

Additional Information

This issue also reproduces in the Playground environment.

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions