rag_api pip install sentence-transformers issue

[peterhoang]

Not sure why it suddenly started happening but I've been getting this error:

rag_api           | Traceback (most recent call last):
rag_api           |   File "/app/main.py", line 39, in <module>
rag_api           |     from psql import PSQLDatabase, ensure_custom_id_index_on_embedding, pg_health_check
rag_api           |   File "/app/psql.py", line 3, in <module>
rag_api           |     from config import DSN, logger
rag_api           |   File "/app/config.py", line 196, in <module>
rag_api           |     embeddings = init_embeddings(EMBEDDINGS_PROVIDER, EMBEDDINGS_MODEL)
rag_api           |   File "/app/config.py", line 163, in init_embeddings
rag_api           |     return HuggingFaceEmbeddings(model_name=model, encode_kwargs={
rag_api           |   File "/usr/local/lib/python3.10/site-packages/langchain_community/embeddings/huggingface.py", line 67, in __init__
rag_api           |     raise ImportError(
rag_api           | ImportError: Could not import sentence_transformers python package. Please install it with `pip install sentence-transformers`.
rag_api           | Traceback (most recent call last):
rag_api           |   File "/usr/local/lib/python3.10/site-packages/langchain_community/embeddings/huggingface.py", line 64, in __init__
rag_api           |     import sentence_transformers
rag_api           | ModuleNotFoundError: No module named 'sentence_transformers'
rag_api           |
rag_api           | The above exception was the direct cause of the following exception:
rag_api           |
rag_api           | Traceback (most recent call last):
rag_api           |   File "/app/main.py", line 39, in <module>
rag_api           |     from psql import PSQLDatabase, ensure_custom_id_index_on_embedding, pg_health_check
rag_api           |   File "/app/psql.py", line 3, in <module>
rag_api           |     from config import DSN, logger
rag_api           |   File "/app/config.py", line 196, in <module>
rag_api           |     embeddings = init_embeddings(EMBEDDINGS_PROVIDER, EMBEDDINGS_MODEL)
rag_api           |   File "/app/config.py", line 163, in init_embeddings
rag_api           |     return HuggingFaceEmbeddings(model_name=model, encode_kwargs={
rag_api           |   File "/usr/local/lib/python3.10/site-packages/langchain_community/embeddings/huggingface.py", line 67, in __init__
rag_api           |     raise ImportError(
rag_api           | ImportError: Could not import sentence_transformers python package. Please install it with `pip install sentence-transformers`.

I'm using the latest main (7984076).

[danny-avila]

Which embeddings provider are you using for rag_api?

[peterhoang]

I'm using HF.

[fuegovic]

you need to specify this in the override file to use the non lite rag_api

  rag_api:
    image: ghcr.io/danny-avila/librechat-rag-api-dev:latest

using the default rag_api lite will output that error when using huggingface

see: https://www.librechat.ai/docs/configuration/rag_api#custom-configuration-eg-hugging-face