Skip to content

Commit c340ec7

Browse files
committed
Clarify folder manifest storage location and rationale
1 parent 0ea880a commit c340ec7

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

docs/src/design/tables/file-type-spec.md

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -315,7 +315,7 @@ Supported hash algorithms: `sha256`, `md5`, `xxhash` (xxh3, faster for large fil
315315

316316
### Folder Manifests
317317

318-
For folders (directories), a **manifest file** is created alongside the folder to enable integrity verification without computing content hashes:
318+
For folders (directories), a **manifest file** is created alongside the folder in the object store to enable integrity verification without computing content hashes:
319319

320320
```
321321
raw_data_pL9nR4wE/
@@ -336,6 +336,11 @@ raw_data_pL9nR4wE.manifest.json
336336
}
337337
```
338338

339+
**Design rationale:**
340+
- Stored in object store (not database) to avoid bloating the JSON for folders with many files
341+
- Placed alongside folder (not inside) to avoid polluting folder contents and interfering with tools like Zarr
342+
- Enables self-contained verification without database access
343+
339344
The manifest enables:
340345
- Quick verification that all expected files exist
341346
- Size validation without reading file contents

0 commit comments

Comments
 (0)