-
Notifications
You must be signed in to change notification settings - Fork 7
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Goal
Allow sitemap crawls to skip failed pages instead of aborting the whole crawl.
Changes
-
Backend
- Parse + normalize
continue_on_failurein_parse_sitemap_loader_parameters(acceptbooland"true"/"false"strings). - Default
continue_on_failure=Trueinaextract_contentwhen omitted.
- Parse + normalize
-
Frontend
- Add “Continue on failure” checkbox to sitemap upload UI (default checked).
- Send
continueOnFailurein API payload; updateSitemapConfig.
-
Docs & i18n
- Document
continue_on_failure(boolean, defaulttrue) in README sitemap section. - Add EN/DE translations (label + tooltip).
- Document
-
Tests
- Cover normalization, defaulting, and payload passing.
Acceptance criteria
- Default behavior continues crawl on failures.
- Setting
falseaborts on first failing page. - All tests pass.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request