This project involves building and automating ETL pipelines using Apache Airflow on AWS EC2 instances, with data extracted, transformed, and loaded into Amazon S3. The entire process is managed and developed remotely using VSCode. Python is utilized as the primary language for pipeline scripts and Airflow DAGs, ensuring efficient orchestration of cloud-based workflows.
-
Notifications
You must be signed in to change notification settings - Fork 0
rohit-ashva900/weather_data_airflow_etl
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published