How to set custom request parameters in modelSpec of custom endpoint

[jameslamine]

I see that the bedrock client's modelSpec supports an additionalModelRequestFields, which sets additional request parameters.

Like this:

preset:
  additionalModelRequestFields:
    my_custom_field: my_custom_value

Do custom endpoints support this? It looks like they don't. I tried to add it, but I'm having trouble figuring out how to plumb the data through.

In OpenAIClient.js I added ...(this.options.additionalModelRequestFields ?? {}):

  async chatCompletion({ payload, onProgress, abortController = null }) {
    let error = null;
    let intermediateReply = [];
    const errorCallback = (err) => (error = err);
    try {
      if (!abortController) {
        abortController = new AbortController();
      }

      let modelOptions = { 
        ...this.modelOptions,
        // Added this line
        ...(this.options.additionalModelRequestFields ?? {})
      };

But the parameter is always empty. I tried to follow how the data gets plumbed through and edit the models/schemas, but I can't get it to work.

Alternatively, could you add support for setting thinking and thinkingBudget on custom endpoints? I know that's an Anthropic-specific setting, but I cannot use the Anthropic client because I am using PortKey as a proxy and I need the ability to set custom headers. LibreChat doesn't support setting custom headers on the Anthropic client. So ANTHROPIC_REVERSE_PROXY alone is not enough.

[jameslamine]

Ok, I ended up implementing what I need #6503