Skip to content

Workflow for combining transformed data from across locations

License

Notifications You must be signed in to change notification settings

clusterflick/data-combined

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

data-combined

This repository contains the automated workflow for combining cinema data for the Clusterflick project.

Purpose

The combining workflow aggregates transformed data from all venues into a single unified dataset. This consolidated data serves as the primary data source for the Clusterflick application and other downstream consumers.

How It Works

The workflow executes the combine command to merge all venue data:

npx clusterflick/scripts combine

This command:

  • Reads the transformed data from all venues
  • Merges the data into a unified format
  • Resolves any data conflicts or duplicates
  • Generates a combined dataset with consistent structure
  • Publishes the combined data as a release

Schedule

The workflow is automatically triggered when the data caching workflow completes successfully. It can also be triggered manually via workflow dispatch if needed.

Downstream Triggers

After successfully combining the data, this workflow triggers:

Maintenance

Dependencies

The workflow requires API keys configured as GitHub secrets:

  • MOVIEDB_API_KEY - For fetching movie metadata from The Movie Database
  • PAT - Personal Access Token for publishing releases and triggering downstream workflows

About

Workflow for combining transformed data from across locations

Resources

License

Stars

Watchers

Forks

Contributors 2

  •  
  •