docs

starswan · starswan · commit e7c46981dc54 · 2026-01-26T15:15:42.000Z
diff --git a/check_broken_links.sh b/check_broken_links.sh
@@ -7,6 +7,7 @@
 
 # get-information-schools.service.gov.uk refuses to be spidered so we
 # can't check broken links to their domain
+# signin.education.co.uk and friends don't respond to robots.txt
 #
 wget --auth-no-challenge -q --user=$2 --password=$3 $1/sitemap.xml -O - \
   | fgrep loc \

Original file line number	Diff line number	Diff line change
`@@ -7,6 +7,7 @@`
`7`	`7`
`8`	`8`	`# get-information-schools.service.gov.uk refuses to be spidered so we`
`9`	`9`	`# can't check broken links to their domain`
	`10`	`+# signin.education.co.uk and friends don't respond to robots.txt`
`10`	`11`	`#`
`11`	`12`	`wget --auth-no-challenge -q --user=$2 --password=$3 $1/sitemap.xml -O - \`
`12`	`13`	`\| fgrep loc \`