Skip to content

v1.5.1

Choose a tag to compare

@hcoura hcoura released this 22 May 00:05
· 113 commits to master since this release
  • Remove username and password from settings since it's removed from crawlera.
  • Include affected spider in logs.
  • Handle situations when crawlera is restarted and reply with 407's for a few minutes
    by retrying the requests with a exponential backoff system.