Popular repositories Loading

1. s3-glue-athena-financial-analysis s3-glue-athena-financial-analysis Public

   This data engineering and analysis workflow for Amazon (AMZN) stock on AWS uses S3 for storage, Glue for schema cataloging, and Athena for serverless SQL queries. Python (Pandas/Matplotlib) is util…

2. etl-sales-pipeline-aws-s3-athena etl-sales-pipeline-aws-s3-athena Public

   Traditional ETL, the starting point of a hands-on Data Engineering journey on AWS. The main focus is on building solid, secure, and reusable pipelines — a crucial foundation before moving on to mor…

3. pipeline_AWSGlue_PySpark pipeline_AWSGlue_PySpark Public

   This project showcases a complete data engineering pipeline on AWS, following best practices in data ingestion, transformation, and analytics — ready for real-world production use or integration wi…

4. lambda-glue-cloudwatch-monitoring lambda-glue-cloudwatch-monitoring Public

   This project implements an automated, serverless data pipeline on AWS. An EventBridge schedule triggers a Lambda function to run an AWS Glue job daily. The entire process is monitored with CloudWat…

5. terraform-aws-data-infra terraform-aws-data-infra Public

   This project uses Terraform and GitHub Actions to build and validate a data infrastructure on AWS. The CI pipeline automates code verification for provisioning an S3 bucket and a Glue catalog, esta…

   HCL

6. analytics-engineering-dbt-redshift analytics-engineering-dbt-redshift Public

   A modeling workflow that transforms raw data into a clean analytical layer using dbt and Amazon Redshift. The project emphasizes best practices with quality tests, documentation, and versioning to …