RAG API not working despite starting it in Docker

[Adetona]

What happened?

Hi,

I setup rag api in my .env and ran compose docker but yet I'm still getting error that it didn't connect.

My .env: RAG_API_URL=http://host.docker.internal:8000

Log: warn: RAG API is either not running or not reachable at http://host.docker.internal:8000, you may experience errors with file uploads.

docker log:

2025-04-25 15:56:25,460 - root - INFO - Initialized embeddings of type: <class 'langchain_openai.embeddings.base.OpenAIEmbeddings'>


/app/app/services/vector_store/factory.py:24: LangChainPendingDeprecationWarning: Please use JSONB instead of JSON for metadata. This change will allow for more efficient querying that involves filtering based on metadata. Please note that filtering operators have been changed when using JSONB metadata to be prefixed with a $ sign to avoid name collisions with columns. If you're using an existing database, you will need to create a db migration for your metadata column to be JSONB and update your queries to use the new operators.


return AsyncPgVector(


2025-04-25 15:56:26,886 - uvicorn.error - INFO - Started server process [1]


2025-04-25 15:56:26,888 - uvicorn.error - INFO - Waiting for application startup.


2025-04-25 15:56:33,448 - uvicorn.error - INFO - Application startup complete.


2025-04-25 15:56:33,450 - uvicorn.error - INFO - Uvicorn running on [http://0.0.0.0:8000⁠](http://0.0.0.0:8000/) (Press CTRL+C to quit)

Steps to Reproduce

1. docker-compose up
2. npm run backend

What browsers are you seeing the problem on?

No response

Relevant log output

Screenshots

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[danny-avila]

The default docker-compose.yml works, which includes RAG API setup. Try it from scratch.

[Adetona]

How do I start from scratch?

[Adetona]

How do I start from scratch?

…

On Fri, Apr 25, 2025 at 5:14 PM Danny Avila ***@***.***> wrote: The default docker-compose.yml works, which includes RAG API setup. Try it from scratch. — Reply to this email directly, view it on GitHub <#7078 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ADZO4W76BQBBEWQ2USOOXZL23JNMVAVCNFSM6AAAAAB34ADMCCVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTEOJUHEZDGNY> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[Odrec]

Use the docker compose that is in the project without changing anything: https://github.com/danny-avila/LibreChat/blob/main/docker-compose.yml

[Adetona]

same error:

2025-04-25 18:28:15 warn: RAG API is either not running or not reachable at http://host.docker.internal:8000, you may experience errors with file uploads.

[Adetona]

I did a fresh install and still the same thing.

[tiefighter]

I'm experiencing the same thing. The RAG_API is set up correctly, but unfortunately, the file upload still isn't working. If you have any suggestions or tips, I'd really appreciate it!

[danny-avila]

A video or screenshot of what you’re experiencing would be helpful. As well as any docker logs for both the LibreChat service (on startup) and RAG API. Screenshots of docker desktop would be best too if using that.

there simply isn’t enough information here to determine the issue when it works on a clean installation for me.

[Adetona]

Is there a way to set up this RAG URL without Docker for this project? Docker is too sluggish on this project and I don't think the hanging is worth it