Let the user configure the embedding model and dimensions in the additional instructions #1415
Description
We get more requests that sentence transformers are not avaiable in other neo4j systems, but OpenAI + VertexAI embedding models are.
Can we let the user select an embedding provider,model, dimensions in the UI in the additional instructions (which we should probably rename to Processing Configuration)
And pass this on with the request, which would overrride the pre-configured embedding model for processing, sentence transformers would still be default choice.
- embedding provider,model, dimensions
- vertexai - gemini-embedding models - the 3 models
- openai - text-embedding-3-small/large/ada-002 + dimsnions
- sentencetransformers 384
Estimate the effort and let's implement it if it's doable in a day or two.
If there was already an embedding model select for the db (should be visible in the vector index configuration) then we should default to that one, if the user chooses a different one there should be a warning because it's for advanced users!
- we can do this later - possibly an option: that we need to recreate the vector index and that existing embeddings would have to be recomputed