[epic] Add support for capturing API changes behind feature gates

[grokspawn]

After our GA release, we need to prioritize continued stability of our API. We have some identified work already which needs to alter the API so we need to identify a path/process of feature-gating the API changes so we can conditionally enable them.

[tmshort]

Possibly related to #1975, or at least dependent on it.