Skip to content

Comments

feat: FreshDiskANN#275

Open
AveryQi115 wants to merge 5 commits intotensorchord:mainfrom
AveryQi115:fresh_diskANN
Open

feat: FreshDiskANN#275
AveryQi115 wants to merge 5 commits intotensorchord:mainfrom
AveryQi115:fresh_diskANN

Conversation

@AveryQi115
Copy link
Contributor

TODO:

  • In memory vamana based on current segments
  • Vamana index with filtering
  • Vamana index with deletion
  • Optimize filtering algorithm

Discussions:

  • Current vamana index implementation use full precision building and searching, as current segments implementation is different from diskANN storage method, how to gradually build full-precision index stored in segments and using quantization to do the construction and searching process?

  • performance and precision

Signed-off-by: AveryQi115 <averyqi115@gmail.com>
Signed-off-by: AveryQi115 <averyqi115@gmail.com>
Signed-off-by: AveryQi115 <averyqi115@gmail.com>
Signed-off-by: AveryQi115 <averyqi115@gmail.com>
Signed-off-by: AveryQi115 <averyqi115@gmail.com>
@marcusinthesky
Copy link

Really excited to see the amazing progress here, have you seen meillisearch's Arroy rust DiskANN implementation: https://github.com/meilisearch/arroy ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants