You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Restructure store paths: objects/ after table, rename store config
- Rename store metadata: dj-store-meta.json → datajoint_store.json
- Move objects/ directory after table name in path hierarchy
- Path is now: {schema}/{Table}/objects/{pk_attrs}/{field}_{token}{ext}
- Allows table folders to contain both tabular data and objects
- Update all path examples and JSON samples
If no partition pattern is specified, files are organized directly under `{location}/{schema}/objects/`.
149
+
If no partition pattern is specified, files are organized directly under `{location}/{schema}/{Table}/objects/`.
152
150
153
-
## Store Metadata (`dj-store-meta.json`)
151
+
## Store Metadata (`datajoint_store.json`)
154
152
155
-
Each object store contains a metadata file at its root that identifies the store and enables verification by DataJoint clients.
153
+
Each object store contains a metadata file at its root that identifies the store and enables verification by DataJoint clients. This file is named `datajoint_store.json` to distinguish it from client configuration files (`datajoint.json`).
156
154
157
155
### Location
158
156
159
157
```
160
-
{location}/dj-store-meta.json
158
+
{location}/datajoint_store.json
161
159
```
162
160
163
161
For cloud storage:
164
162
```
165
-
s3://bucket/my_project/dj-store-meta.json
163
+
s3://bucket/my_project/datajoint_store.json
166
164
```
167
165
168
166
### Content
@@ -193,7 +191,7 @@ The store metadata file is created when the first `object` attribute is used:
Note: The `objects/` directory follows the table name, allowing each table folder to also contain tabular data exports (e.g., `data.parquet`) alongside the objects.
333
+
334
334
### Partitioning
335
335
336
336
The **partition pattern** allows promoting certain primary key attributes to the beginning of the path (after `location`). This organizes storage by high-level attributes like subject or experiment, enabling:
0 commit comments