Skip to content

Clarify Trible integration roadmap subtasks #25

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
somethingelseentirely merged 2 commits into from
Oct 14, 2025
Merged

Clarify Trible integration roadmap subtasks #25

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
632c911
Detail Trible integration subtasks
somethingelseentirely Oct 14, 2025
ed36cd5
Merge branch 'main' into codex/integrate-tantivy-with-triblespace-mid…
somethingelseentirely Oct 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,7 @@ have been removed to keep the changelog focused on Yeehaw's history.
- remove `quickwit` feature and associated asynchronous APIs.
- remove obsolete document type codes.
- capture plan to drop Tantivy's `Directory` layer in favor of Trible-native blob and view APIs.
- refine roadmap subtasks for metadata commits and Trible-native storage migration.
- remove delete queue and segment delete tracking; document removal now handled externally by triblespace.
- remove operation stamp infrastructure in preparation for commit-handle redesign.
- simplify searcher generation to track segment ids only and drop legacy delete tests.
7 changes: 5 additions & 2 deletions INVENTORY.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,10 +14,13 @@ This document outlines the long term plan to rewrite this project so that it rel
1. **Store fulltext metadata in commit tribles**
- Define a `fulltext` attribute in the Trible namespace.
- Represent segment lists, schema and other metadata as entities attached to each commit.
- Replace the `meta.json` file with this trible based representation.
- Replace the `meta.json` file with this trible based representation and load metadata from the latest commit handle.
- Provide shims for reading legacy indexes long enough to migrate existing data.

2. **Adopt Trible-native storage primitives**
- Remove the Tantivy `Directory` abstraction and expose the Trible Space blob and view APIs directly to index components.
- Replace the Tantivy `Directory` trait with a thin storage module that fetches blobs and views from Trible Space directly.
- Update index building, merging and searcher initialization so they operate on append-only segment blobs without filesystem assumptions.
- Delete lock file, watcher and atomic write helpers that only exist for mutable directories.
- Provide helper constructors for in-memory, file-backed and object-storage Trible deployments so the search engine never touches filesystem paths itself.

3. **Remove `Opstamp` and use commit handles**
Expand Down
Loading