Can guidance be integrated with already existing SageMaker inference endpoints?

[existme]

Hello,

I have a few inference endpoints hosted on AWS SageMaker and I'm curious if guidance can be directly integrated with such endpoints. Are there any samples to help me understand better?

Thank you.

[nchammas]

Guidance supports OpenAI, and SageMaker does support the OpenAI Chat Completions API, so perhaps the work required to get Guidance to work directly with SageMaker is not too much.

It would be nice to see this support in Guidance for those of us already on AWS.