Disallow: // shouldn't behave the same as Disallow: / #113
Description
https://www.ibm.com/robots.txt has DIsallow:// and it appears that they expect it to not disallow everything. reppy treats it the same as Disallow:/
{{ message }}
https://www.ibm.com/robots.txt has DIsallow:// and it appears that they expect it to not disallow everything. reppy treats it the same as Disallow:/