Skip to content

Comments

fix: rollback queue counters for blacklisted child URLs#9080

Closed
harshang03 wants to merge 1 commit intomikf:masterfrom
harshang03:fix/8513-queue-counter-rollback
Closed

fix: rollback queue counters for blacklisted child URLs#9080
harshang03 wants to merge 1 commit intomikf:masterfrom
harshang03:fix/8513-queue-counter-rollback

Conversation

@harshang03
Copy link

Summary

  • add queue rollback metadata markers for extractors that pre-increment counters for external links
  • rollback queue counter fields when child queue entries are skipped by blacklist filtering
  • wire rollback markers into Bellazon and XenForo external-link queue paths
  • add job-level regression tests for filtered vs non-filtered queue handling

What changed

  • gallery_dl/job.py: rollback queue counters on filtered and duplicate queue skips
  • gallery_dl/extractor/message.py: define queue rollback metadata keys
  • gallery_dl/extractor/common.py: helper to annotate queue rollback metadata
  • gallery_dl/extractor/bellazon.py: mark external queue counters for rollback
  • gallery_dl/extractor/xenforo.py: mark external queue counters for rollback
  • test/test_job.py: add regression coverage for queue counter rollback

Test plan

  • ./.venv/bin/python -m pytest test/test_job.py

Fixes #8513

When queue URLs are blocked by extractor blacklist filters, rollback parent queue counters so fields like num/count stay aligned with actually processed links.
@mikf mikf closed this Feb 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Links to blacklisted sites are being counted towards num metadata key

2 participants