Skip to content

Merge stg to main: Link checker false positive fixes#249

Merged
longwind48 merged 2 commits intomainfrom
stg
Jan 4, 2026
Merged

Merge stg to main: Link checker false positive fixes#249
longwind48 merged 2 commits intomainfrom
stg

Conversation

@longwind48
Copy link
Collaborator

Summary

Merges staging to main with link checker improvements that fix false positives in the monthly batch job.

Changes included

Fix link checker false positives (#248)

  • Add soft 404 detection for CMS systems returning 404 with valid content
  • Add Cloudflare 503/52x status code handling
  • Increase default timeout from 10s to 20s for slow sites
  • Increase max_redirects from 3 to 10 for complex redirect chains

Impact

Reduces false positives in the monthly link check batch job, preventing valid schemes from being incorrectly marked as status=inactive.

Test plan

  • Tested in staging with known problem URLs
  • All previously failing URLs now correctly detected as alive

- Add soft 404 detection: check if 404 responses serve valid HTML content
- Add Cloudflare 503/52x status code handling (treat as alive)
- Add helper to detect Cloudflare responses via headers (cf-ray, cf-mitigated)
- Increase default timeout from 10s to 20s for slow sites
- Increase max_redirects from 3 to 10 for sites with complex redirect chains
@longwind48 longwind48 self-assigned this Jan 4, 2026
@longwind48 longwind48 merged commit 9cbcc00 into main Jan 4, 2026
10 checks passed
@github-actions
Copy link

🎉 This PR is included in version 3.4.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant