Skip to content

Commit 22adee0

Browse files
committed
Add changelog note for the directio option
1 parent 6e28282 commit 22adee0

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

docs/changelog/125921.yaml

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
pr: 125921
2+
summary: Allow direct IO for BBQ rescoring
3+
area: Vector Search
4+
type: feature
5+
highlight:
6+
title: Allow direct IO for BBQ rescoring
7+
body: |-
8+
BBQ rescoring can be drastically affected by the amount of available RAM
9+
for use in the page cache. When there is not enough RAM to fit the whole
10+
vector data in memory, BBQ search latencies can be affected by as much as 5000x.
11+
Specifying the `vector.rescoring.directio=true` Java option on all vector search
12+
nodes changes rescoring to use direct IO, which eliminates these very high latencies
13+
from searches in low-memory scenarios, at a cost of a reduction
14+
in vector search performance for BBQ indices.
15+
16+
This option is released in 9.1 as a tech preview whilst we analyse its effect
17+
for a variety of use cases.
18+
issues: []

0 commit comments

Comments
 (0)