Skip to content

gh-79638: Treat an unreachable robots.txt as "disallow all"#138555

Open
serhiy-storchaka wants to merge 1 commit intopython:mainfrom
serhiy-storchaka:robotparser-unreachable
Open

gh-79638: Treat an unreachable robots.txt as "disallow all"#138555
serhiy-storchaka wants to merge 1 commit intopython:mainfrom
serhiy-storchaka:robotparser-unreachable

Commits

Commits on Sep 5, 2025