LanceDB taking too much space

[therealcyberlord]

I noticed as I run more and more queries, the lancedb directory becomes larger and larger, reaching over 100 Gb. Is there any solution to this as I am running out of storage.

I've considered deleting the directory as a temporary solution, but I'm wondering whether that could affect the retrieval process. It is also not a permanent fix for longer runs.

Thanks for the help