Files are uploaded successfully, but the model doesn't detect the file.

[timmanik]

Hi,

I am able to upload files. The rag_api service is running.

However, when after uploading the file into the chatbox, the model doesn't seem to detect that there is a file.

Attached is a screenshot of the docker-compose logs. As you can see, there is a successful POST request made to the rag_api service.

Here is a screenshot of the chatbox.

I am using huggingface as my embeddings provider. Here is how I defined it:

Below is my docker-compose.override.yml

Happy to provide additional info as well.

[timmanik]

Update: This may be a bug with the new native Bedrock integration. I tried file uploads with other endpoints like Anthropic and Ollama. Those endpoints are able to detect the file and chat about the file.

[danny-avila]

Not implemented yet for Bedrock, will be within the week.

[timmanik]

Thanks, Danny. Great work on the native AWS Bedrock launch.

[ldavis9000aws]

@timmanik Ran into this today as well. I'm using LiteLLM for Bedrock as a workaround for any attachments I want to add until the issue is resolved.

[danny-avila]

This should now be resolved with this PR: #4322