File tree Expand file tree Collapse file tree 7 files changed +12
-12
lines changed
geecs_data_utils/scans_database Expand file tree Collapse file tree 7 files changed +12
-12
lines changed Original file line number Diff line number Diff line change 11"""
2- Provides utilities to construct partitioned parquet 'scans database '.
2+ Provides utilities to construct partitioned parquet 'scans scans_database '.
33
44Structured metadata records (`ScanEntry`) are created for each scan.
55Supports streaming scan metadata to Parquet format for persistent
3030
3131from geecs_data_utils .scan_data import ScanData
3232from geecs_data_utils .utils import ScanTag
33- from geecs_data_utils .database .entries import ScanEntry , ScanMetadata
34- from geecs_data_utils .database .database import ScanDatabase
33+ from geecs_data_utils .scans_database .entries import ScanEntry , ScanMetadata
34+ from geecs_data_utils .scans_database .database import ScanDatabase
3535from geecs_data_utils .type_defs import parse_ecs_dump
3636
3737logger = logging .getLogger (__name__ )
@@ -216,7 +216,7 @@ def build_from_directory(
216216 Returns
217217 -------
218218 ScanDatabase
219- In-memory database containing all found scan entries.
219+ In-memory scans_database containing all found scan entries.
220220 """
221221 db = ScanDatabase ()
222222 scan_counter = 0
@@ -281,7 +281,7 @@ def stream_to_parquet(
281281 }
282282 except Exception as e :
283283 logger .warning (
284- f"Could not load existing database for deduplication: { e } "
284+ f"Could not load existing scans_database for deduplication: { e } "
285285 )
286286
287287 buffer = []
Original file line number Diff line number Diff line change 11"""
2- Provides a searchable interface to a partitioned scans database stored in Parquet format.
2+ Provides a searchable interface to a partitioned scans scans_database stored in Parquet format.
33
44This module defines the `ScanDatabase` class, which enables efficient querying of
55experiment scan metadata stored as a Hive-style partitioned Parquet dataset (partitioned
Original file line number Diff line number Diff line change 11"""
2- Scan database entry schema.
2+ Scan scans_database entry schema.
33
44This module defines structured models for representing scan entries and
55associated metadata in the GEECS data ecosystem. These models are used
1717Notes
1818-----
1919These models are primarily intended for use in building and querying a
20- structured scan database using the `ScanDatabase` class. The models use
20+ structured scan scans_database using the `ScanDatabase` class. The models use
2121Pydantic for data validation and serialization.
2222"""
2323
File renamed without changes.
File renamed without changes.
File renamed without changes.
Original file line number Diff line number Diff line change 1414from pathlib import Path
1515from datetime import date
1616
17- from geecs_data_utils .database .builder import ScanDatabaseBuilder
18- from geecs_data_utils .database .database import ScanDatabase
19- from geecs_data_utils .database .entries import ScanEntry
17+ from geecs_data_utils .scans_database .builder import ScanDatabaseBuilder
18+ from geecs_data_utils .scans_database .database import ScanDatabase
19+ from geecs_data_utils .scans_database .entries import ScanEntry
2020
2121
2222TEST_DATA_ROOT = Path ("/Volumes/hdna2/data" )
@@ -27,7 +27,7 @@ def test_scan_database_builder_runs():
2727 Test building a ScanDatabase from a single scan directory.
2828
2929 This test verifies that:
30- - The database is built without error.
30+ - The scans_database is built without error.
3131 - A single scan entry is returned.
3232 - The scan entry contains valid metadata, file paths, and devices.
3333
You can’t perform that action at this time.
0 commit comments