FallbackModel returns response + list of exceptions

[pedrurrego]

Question

Hello guys, when using the FallbackModel, do you think it will be possible to include the exceptions in the return of the request method?

it's already great to have a way to automatically switch between models if any exception is raised. However, if we can see the models that failed and the error codes, we'll have traceability and more information when selecting models.

thanks!

Additional Context

No response

[DouweM]

@pedrurrego We can't change the return value of FallbackModel.request to not match that of Model.request, as it's meant to be usable everywhere regular models are.

The original attempted requests and exceptions also still show up in an observability tools like https://ai.pydantic.dev/logfire.

It would help to understand how you're using FallbackModel and what you'd like to do with the exceptions, to figure out what the best way to expose them would be.

[github-actions]

This issue is stale, and will be closed in 3 days if no reply is received.

[github-actions]

Closing this issue as it has been inactive for 10 days.