What would you like to be added:

Build a general abstraction layer for both ModelRoute/ModelServer and Gateway API/Inference Extension

Both API will be converted to this abstraction layer first. And the core processing logic is implemented based on the abstraction layer.

Why is this needed:

Make the architecture more clear and the core processing logic more stable.