Guardrails supports on SDK

[adarshkr]

Is there a plan to support guardrails on the LiteLLM SDK, similar to the proxy?

[ishaan-jaff]

We can support this - what's the ideal interface you'd want to do this with ?

[adarshkr]

We intend to develop a separate Guardrails Hub, similar to GuardrailsAI Hub, but built using NeMo Guardrails. The idea is to allow invoking these guardrails within the LiteLLM SDK based on configurations.

Would love to hear your thoughts on the best way to integrate this within LiteLLM SDK!