CRUD like semantics?

[thobson]

I need to implement CRUD like semantics but I'm not sure how best to implement this in haystack.

In particular the problem relates to the update and delete.

Currently I'm generating ids with "id_hash_keys": ["content", "meta"], but this means I can't update a document with new content as it simply creates another version (with a different id)

I thought of using "id_hash_keys": ["meta"] but I'm not sure how this would work with the preprocessor which splits large documents into smaller ones.

I tried to perform a delete_documents(filter=meta) followed by a fresh ingestion but I sometimes get elasticsearch.exceptions.ConflictError.

Has anyone else implemented CRUD like operations in haystack. If so do you have any advice?

Thanks

Toby

[vblagoje]

@thobson, I'll have to read up on this myself, but my best guess is that this is the domain of the underlying document store. My cursory look at the code base didn't find any CRUD support on the HAystack level.

[thobson]

Thanks