Skip to content

SIMSBIOHUB-882: Refactor Ingestion Job to support multiple uploads#352

Draft
dwhogan wants to merge 6 commits intodevfrom
SIMSBIOHUB-882
Draft

SIMSBIOHUB-882: Refactor Ingestion Job to support multiple uploads#352
dwhogan wants to merge 6 commits intodevfrom
SIMSBIOHUB-882

Conversation

@dwhogan
Copy link
Collaborator

@dwhogan dwhogan commented Mar 3, 2026

Links to Jira Tickets

Description of Changes

Update the ingestion jobs that currently take submission_id so they can take submission_upload_id instead.

This makes ingestion upload-scoped, so the same submission_id can be re-published by creating a new upload and running ingestion again without colliding with (or overwriting) prior runs.
Job logging and validation/processing status should be attributable to the specific upload being processed, not the parent submission.

Testing Notes

Run make test

@dwhogan dwhogan added the Not Ready For Review Addressing feedback and/or refactoring label Mar 3, 2026
@dwhogan dwhogan changed the title SIMSBIOHUB-882: Refactor Ingestion Jobs to key on upload_id instead of submission_id SIMSBIOHUB-882: Refactor Ingestion Jobs to key on upload_id Mar 3, 2026
@dwhogan dwhogan changed the title SIMSBIOHUB-882: Refactor Ingestion Jobs to key on upload_id SIMSBIOHUB-882: Refactor Ingestion Jobs to support multiple uploads Mar 3, 2026
@dwhogan dwhogan changed the title SIMSBIOHUB-882: Refactor Ingestion Jobs to support multiple uploads SIMSBIOHUB-882: Refactor Ingestion Job to support multiple uploads Mar 3, 2026
@sonarqubecloud
Copy link

sonarqubecloud bot commented Mar 3, 2026

@dwhogan dwhogan added Ready For Review PR is ready for review and removed Not Ready For Review Addressing feedback and/or refactoring labels Mar 4, 2026
* Both IDs travel together through publisher, job handler, validation tracking,
* and feature insertion. The trigger resolves both before publishing.
*/
export interface IngestionJobData {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we simplify by just passing submission_upload_id?

@dwhogan dwhogan added Not Ready For Review Addressing feedback and/or refactoring and removed Ready For Review PR is ready for review labels Mar 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Not Ready For Review Addressing feedback and/or refactoring

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants