LibreChat custom Agent access to uploaded files

[shahid-nca]

I want to create an agent to enable question answering over CV files; I want to follow the recommended approach mentioned here: https://python.langchain.com/docs/how_to/sql_csv/ and deploy this as a custom endpoint.

One thing that is unclear to me is how I can access the raw files that the user uploaded- in this case, CSV files. The RAG API has endpoints to get the whole file embedding context or the top K query results, but is there any mechanism to get the raw uploaded file (not the embeddings) that I can manipulate further within my agent code/application?

[danny-avila]

When using the RAG API, there is no way to do this. However, I recommend trying uploading files to the Code Interpreter API, which uses files directly, they can also be downloaded: https://code.librechat.ai/docs

[shahid-nca]

@danny-avila, thanks for your response and suggestion. Just wondering, theoretically, if it is possible to create a tool to get access to the uploaded file following the example of FileSearch capability (api/app/clients/tools/util/fileSearch.js) and do further processing on it (like passing it to a SQL agent).

If this is possible, then I can just create an agent from the UI and leverage this proposed tool instead of the custom endpoint.