[Question]: Unable to connect to LibreChat via Cloudflared tunnel

[MikeNatC]

What is your question?

I am trying to connect a cloudflared tunnel to the LibreChat service running in a docker container but I keep getting a 502 Bad Gateway Error.

More Details

Setup Environment:

LibreChat is running in a Docker container that is listening on port 3080 and is accessible by 'http://localhost:3080'. It's expected that cloudflared (also running in a Docker container) will tunnel requests to this service.

Error Messages:

You are receiving the following error messages from the cloudflared logs:

2024-12-02T00:58:59Z ERR error="Unable to reach the origin service. The service may be down or it may not be responding to traffic from cloudflared: dial tcp [::1]:3080: connect: connection refused" connIndex=0 event=1 ingressRule=0 originService=http://localhost:3080

Troubleshooting Steps:

Checks Performed:

Port Listening: Iconfirmed using netstat that there is indeed a service listening on both 0.0.0.0:3080 and [::]:3080. However, there were repeated [::1]:3080 listings.

Access Testing: I attempted to access the service directly using curl, and it appears that when testing connectivity from within the Docker environment, the request succeeds. However, when tested from the cloudflared tunnel container, it fails.

Networking Issues:

I obtained the IP address of the LibreChat container but I am unable to access it using my webbrowser or to ping the IP address from outside the container.

I am very grateful for any help or advice.

What is the main subject of your question?

Other

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[berry-13]

if you're using Linux, try setting 127.0.0.1 or the IP address of the machine hosting LibreChat on your local network

[MikeNatC]

Thank you @berry-13 for the quick response! LibreChat is being run in a Docker on a Windows desktop. Should I set the IP address of the windows desktop to 127.0.0.1?

From my uneducated attempts to troubleshoot this problem, the issue that I'm facing seems to be due to the docker container for the Cloudflared tunnel being unable to communicate with the docker container for LibreChat.

[berry-13]

exactly! Docker Desktop often runs WSL under the hood, so try connecting using both 127.0.0.1 and, if that doesn’t work, your local machine's IP address. additionally, ensure LibreChat is accessible on other devices within the network. for instance, connect your phone to the same network as your PC, enter your machine’s IP address and port in the browser, and you should be able to access LibreChat

[MikeNatC]

Once again, thank you for the help! I'm at my day job now but I'll try out your suggestion when I am home later tonight. Fingers crossed that this solves my issue. 🤞

[MikeNatC]

@berry-13 Thank you so much for your help! I managed to get it to work by identifying my local machine's IP address and then using that as the origin server in the Cloudflared tunnel setting.

As a suggestion, maybe it might be useful to someone else to update the website (https://www.librechat.ai/docs/remote/cloudflare) to reflect this step?

[berry-13]

you're welcome!

yes, exactly! I'll add it as soon as I get the chance @MikeNatC

[rarestg]

Hi folks, any advice for doing this over a railway deployment? I can't find a way to SSH into the private network they spin up for the containers so I haven't been able to scan for what IP addresses are the ones that work. I've tried localhost:3080, librechat:3080, and 127.0.0.1:3080 all to no avail. The cloudflared container says there's no traffic there.