-
Notifications
You must be signed in to change notification settings - Fork 25.5k
Cuvs snapshot update #136057
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Cuvs snapshot update #136057
Conversation
Pinging @elastic/es-search-relevance (Team:Search Relevance) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A small change needed but looks good
compileOnly project(':server') | ||
implementation('com.nvidia.cuvs:cuvs-java:25.10.0') { | ||
implementation('com.nvidia.cuvs:cuvs-java:25.10.0-815d86dd') { | ||
changing = true // Ensure that we get updates even when the version number doesn't change. We can remove this once things stabilize |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We probably don't need this anymore as we have the -hashsuffix
now, right @brianseeders ?
x-pack/plugin/gpu/src/main/java/org/elasticsearch/xpack/gpu/codec/DatasetUtilsImpl.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
CuVSMatrix.DataType dataType | ||
) { | ||
try { | ||
return (CuVSMatrix) createDatasetWithStrides$mh.invokeExact(memorySegment, size, dimensions, rowStride, columnStride, dataType); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
As we don't need columnStride and it's not really supported (yet) in cuvs-java, I think you might want to pass -1 here like you did in 14088bd. So you can remove all the int columnStride
params from all these functions and just have rowStride.
But up to you (I'm fine either way).
Update Nvidia CUVS java library to a newer version that includes strides