Skip to content

Hello, is it possible to forward some of the headers from request I send to Bifrost to the LLM provi #944

@akshaydeo

Description

@akshaydeo

Discord Thread Context

Thread: Hello, is it possible to forward some of the headers from request I send to Bifrost to the LLM provi
Link: https://discord.com/channels/1371790330269007932/1441757529997709312
Created by: akshay_deo (361806850561146880)

Recent Thread Messages

akshay_deo: is it a custom provider?
akshay_deo: we do allow that for custom provider I think
akshay_deo: but Ill confirm for both

can you elaborate the use case
backslash_98887: I’m looking to connect my ChatGPT account to Bifrost so I can use Codex CLI and Kilo Code through it. What matters to me is having a clear overview of token usage and being able to access multiple LLM...
backslash_98887: I saw you already do something in this regard for Anthropic in transports/bifrost-http/integrations/anthropic.go
There you extract headers using extractHeadersFromRequest and set it to context. ...
akshay_deo: yep yep - I missed tracking this - adding a github ticket
akshay_deo: will pick with next release

Discord Thread: https://discord.com/channels/1371790330269007932/1441757529997709312

Metadata

Metadata

Assignees

Projects

Status

Done

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions