File tree Expand file tree Collapse file tree 1 file changed +18
-0
lines changed Expand file tree Collapse file tree 1 file changed +18
-0
lines changed Original file line number Diff line number Diff line change 1+ pr : 125921
2+ summary : Allow direct IO for BBQ rescoring
3+ area : Vector Search
4+ type : feature
5+ highlight :
6+ title : Allow direct IO for BBQ rescoring
7+ body : |-
8+ BBQ rescoring can be drastically affected by the amount of available RAM
9+ for use in the page cache. When there is not enough RAM to fit the whole
10+ vector data in memory, BBQ search latencies can be affected by as much as 5000x.
11+ Specifying the `vector.rescoring.directio=true` Java option on all vector search
12+ nodes changes rescoring to use direct IO, which eliminates these very high latencies
13+ from searches in low-memory scenarios, at a cost of a reduction
14+ in vector search performance for BBQ indices.
15+
16+ This option is released in 9.1 as a tech preview whilst we analyse its effect
17+ for a variety of use cases.
18+ issues : []
You can’t perform that action at this time.
0 commit comments