API contract with Jenkins - find out when there are breaking API changes

We need to know when Jenkins makes a breaking change to an API that we use. Especially as we use some unofficial APIs such as the `wfapi` ones.

Should we try to automatically poll the API endpoints we care about and look for changes?