[Enhancement]: Support NO_PROXY / HTTP(S)_PROXY to enable using internal and cloud hosted endpoints behind a proxy #6842
JulianHandrup
started this conversation in
Feature Requests & Suggestions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
What features would you like to see added?
Hi,
I'd like to see the following feature added:
Enabling the usage of cloud based and internally hosted models simultaneously when being behind a proxy.
Currently it's not possible to have for example an Azure-OpenAI-Endpoint together with a custom Endpoint (on premise) since the PROXY env-var affects either both or none of them.
The used "HttpsProxyAgent" seems to not care about env vars like NO_PROXY whereas "ProxyAgent" would, thus enabling Azure to go through the proxy and the on-premise model to connect without the proxy.
More details
The reason I'm asking:
I ran into some troubles after my network admins asked me to not use the proxy for our LibreChat installation any more.
Removing the PROXY from the env variables did the trick but it rendered the Azure-OpenAI-Endpoint unusable at the same time since that connection would still need to go through the company proxy.
I tried to set PROXY together with "NO_PROXY" but it seems that HttpsProxyAgent does not care about wheter a connection should or should not use the proxy.
ProxyAgent seems to check for NP_PROXY and other env-vars though.
Please consider a switch from https-proxy-agent to proxy-agent.
Which components are impacted by your request?
No response
Pictures
No response
Code of Conduct
Beta Was this translation helpful? Give feedback.
All reactions