[3.15] gh-79638: Test other HTTP error codes besides 403 in test_robotparser (GH-149569)

[3.15] gh-79638: Test other HTTP error codes besides 403 in test_robotparser (GH-149569) #256587