Supply Precomputed Embeddings Instead of Function #11765
WaleedAlfaris
announced in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
I am currently attempting to use MUSE as my embedding function with a local ChromaDB. The problem I am facing is that when attempting to populate the DB with the Chroma.from_documents() method, I get an OOM error as the embedding function is trying to process all the documents. However, I do not get an OOM if a run the embedder manually on each document in sequence.
Would be great if I could embed the documents ahead of time and then provide these embeddings to the from_documents() method when populaitng the DB. I cna then use the embedding function for querying, since the queries will be much smaller and not run into this OOM issue.
Is something like this possible?
Full error:
Beta Was this translation helpful? Give feedback.
All reactions