How are extra incoming headers handled?

[elabbarw]

If i receive chat completion events with extra X-* headers, how are they handled?

[krrishdholakia]

Hey @elabbarw great question.

In most cases, these are ignored.

Special headers documented here are used.

[krrishdholakia]

If you'd like to:

• pass all x-* headers to the backend api, you can do that with -

general_settings:
  forward_client_headers_to_llm_api: true

Note: this is not recommended, as we saw some calls fail due to this.

• pass client openai org id to OpenAI API, you can do that with

general_settings:
  forward_openai_org_id: true