Update embeddings in ES

[ozyurtf]

Hello,

I have an elasticsearch database. And I used embedding retriever and updated the embeddings with the code below:

document_store.update_embeddings(retriever = embedding_retriever, filters = filters, update_existing_embeddings=True)

So, can you explain what happens if I set update_existing_embeddings as True and what happens if I set it to False when the new data comes in the future ? The ideal scenario is to set it to False when the new data arrives ?

[ZanSara]

Hello! update_existing_embeddings=False will ignore existing embeddings in the document store and recompute them all. It's useful if you believe your documents have changed content and you want to make sure all embeddings are in sync. Normally if you are not modifying the content of your Documents, you can keep it set to False, which will compute embeddings only for documents which have an empty embedding field.

[ozyurtf]

I am a little bit confused.

You said that update_existing_embeddings=False will ignore existing embeddings in the document store and recompute all the embeddings.

But in another part, you said that keeping update_existing_embeddings as False will compute embeddings only for documents which have an empty embedding field.

Can you elaborate how this works more ?