It seems the library only supports JSON responses. I have an endpoint that returns an image, and the result of testing it is a JSON::ParserError. There are a number of places where the response is parsed as JSON, but the first one where the error occurs is in the response_body method of validator.rb.