Add OllamaRerankDriver

[shhlife]

Currently there's no way to Rerank using the RagEngine unless you have a Cohere account. It would be very helpful to have a way to run a local RerankDriver. Would it be possible to make one for Ollama? It has two reranking models available..

linux6200/bge-reranker-v2-m3
zyw0605688/bge-reranker-v2-m3

[shhlife]

Instead of Ollama - can we create a LocalRerankDriver?

[collindutter]

Great idea!

[collindutter]

Can you point me to Ollama's rerank functionality? I can't seem to find anything on it.

[shhlife]

I don't know if there is actually anything with Ollama that has it that's been released.. ollama/ollama#7219

maybe a LocalRerankDriver is a better way to go in the meantime?

[collindutter]

#1657