Unhandled 'error' event

[crypticviper]

Hello, thanks for this tool. Makes life easy to download interfacelift wallpapers 👍

However, I get below error when running the tool without the limit flag. It usually happens at about page 130.

Scanning Page 133...
Scanning Page 134...
node:events:497
      throw er; // Unhandled 'error' event
      ^

Error: socket hang up
    at TLSSocket.socketOnEnd (node:_http_client:516:23)
    at TLSSocket.emit (node:events:531:35)
    at endReadableNT (node:internal/streams/readable:1696:12)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21)
Emitted 'error' event on ClientRequest instance at:
    at TLSSocket.socketOnEnd (node:_http_client:516:9)
    at TLSSocket.emit (node:events:531:35)
    at endReadableNT (node:internal/streams/readable:1696:12)
    at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
  code: 'ECONNRESET'
}

Node.js v21.6.1

[stevenbenner]

Thank you for the bug report.

It looks like I will need to add retry behavior for the page scraper.

This is very similar to issue #22. But that issue was specific to the image downloads, so I didn't add any retry logic for when the script is just walking the pages. I believe that a similar solution would work here.