Huge sitemap takes forever to load

[teammakdi]

Which package is this bug report for? If unsure which one to select, leave blank

None

Issue description

https://dev.to/sitemap-index.xml has lot of links, hence takes forever to load. Maybe we can add a timeout/url limit parameter.

Code sample

import { Sitemap } from 'crawlee';

const { urls } = await Sitemap.load('https://dev.to/sitemap-index.xml');
console.log(urls.length)

Package version

3.8.1

Node.js version

20.11.1

Operating system

Ubuntu

Apify platform

• Tick me if you encountered this issue on the Apify platform

I have tested this on the next release

No response

Other context

No response