This repository was archived by the owner on Apr 25, 2021. It is now read-only.
Ignore sets #8
Description
It should be possible to add ignored URL pattern (regex) to recursive crawls. They should be updateable (add/remove pattern) while the job is running.