Skip to content

Proper way to model-provider specific options through LiteLLM integration #564

@SambhavAnand

Description

@SambhavAnand

Reopening this issue here:
#521

I updated the system to pass data using providerOptions, but the Agents Tracing in the OpenAI Platform is showing empty Provider Options passed down.
I even tried both snake and camel casing it but nothing went in

Image

But my Code has this:

{
          model: aisdk(google(model)),
          modelSettings: {
            providerData: {
              providerOptions: {
                google: {
                  max_output_tokens: maxOutputTokens,
                  maxOutputTokens,
                  thinking_config: {
                    thinking_budget: thinkingBudget,
                    include_thoughts: true,
                  },
                  thinkingConfig: {
                    thinkingBudget,
                    includeThoughts: true,
                  },
                  temperature: 0,
                },
              },
            },
          },
        };

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions