Skip to content

Conversation

@sethstoudenmier
Copy link
Contributor

@sethstoudenmier sethstoudenmier commented Nov 7, 2025

Description:

Uses the EMR Delta tables by location to support cutover to EMR. This location references will be reverted at a later date.

Technical Details:

The Databricks Delta tables are no longer updated as part of the pipeline. This means we need to use the new EMR Delta tables. Due to how these jobs are currently run that means pointing to a specific location in S3.

Requirements for PR Merge:

  1. Unit & integration tests updated
  2. API documentation updated (examples listed below)
    1. API Contracts
    2. API UI
    3. Comments
  3. Data validation completed (examples listed below)
    1. Does this work well with the current frontend? Or is the frontend aware of a needed change?
    2. Is performance impacted in the changes (e.g., API, pipeline, downloads, etc.)?
    3. Is the expected data returned with the expected format?
  4. N/A Appropriate Operations ticket(s) created
  5. Jira Ticket(s)
    1. DEV-13706

Explain N/A in above checklist:

@sethstoudenmier sethstoudenmier added the hotfix [PR] makes a change in production label Nov 7, 2025
@sethstoudenmier sethstoudenmier merged commit d86e1a1 into master Nov 7, 2025
36 of 37 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

hotfix [PR] makes a change in production

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants