fix: add X-Robots-Tag header to prevent robot indexing and following#776

Open

itslenny wants to merge 3 commits intomasterfrom

fix/add-robots-header

Commits on Oct 6, 2025

fix: add X-Robots-Tag header to prevent robot indexing and following
itslenny
committed

Commits on Oct 7, 2025

add ability to override x-robots-tag header
itslenny
committed

Commits on Oct 9, 2025

add x-robots-tag validation
itslenny
committed