Skip to content

multiple improvements#137

Merged
vredchenko merged 3 commits intomainfrom
multiple-bugfixes
Jul 28, 2025
Merged

multiple improvements#137
vredchenko merged 3 commits intomainfrom
multiple-bugfixes

Conversation

@vredchenko
Copy link
Collaborator

@vredchenko vredchenko commented Jul 25, 2025

  • bugfix: updated database schema: atlas tile to reference grid via grid_uuid FK
  • add convenience script to quickly see database row totals
  • test EPU agent watcher persists data to DB (not just parser) smartem-devtools#50
  • DB connection pooling
  • atlas data processing fix
    1. Pydantic Schema: Made description field optional in AtlasData
    2. Parser: Added null checks before accessing atlas_data.gridsquare_positions
    3. Watcher: Applied same defensive checks to runtime atlas processing
./tools/db_table_totals.py 
Database Table Row Counts
========================================
acquisition                                1
atlas                                      1
atlastile                                 35
atlastilegridsquareposition              466
grid                                       2
gridsquare                               466
foilhole                               3,278
micrograph                               606
qualitypredictionmodel                     4
qualitypredictionmodelparameter            0
qualitypredictionmodelweight           3,192
qualityprediction                     14,976
========================================
TOTAL                                 23,027

after fix for atlas tiles processing:

Database Table Row Counts
========================================
acquisition                                1
atlas                                      4
atlastile                                105
atlastilegridsquareposition            1,504
grid                                       4
gridsquare                             2,027
foilhole                              12,473
micrograph                             1,489
qualitypredictionmodel                     4
qualitypredictionmodelparameter            0
qualitypredictionmodelweight          10,212
qualityprediction                     57,308
========================================
TOTAL                                 85,131

@vredchenko vredchenko changed the title [WIP] multiple improvements multiple improvements Jul 28, 2025
@vredchenko vredchenko merged commit 5b49947 into main Jul 28, 2025
32 checks passed
@vredchenko vredchenko deleted the multiple-bugfixes branch July 28, 2025 11:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant