Skip to content

This repository offers a robust collection of complex and reusable Apache Airflow DAGs, meticulously crafted for production environments. It lays down a solid foundation for your data orchestration and MLOps pipeliness

License

Notifications You must be signed in to change notification settings

vectorc0de/airflow-dags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

containerdevs.com - Airflow DAGs Repository

This repository contains complex and reusable DAGs for Apache Airflow, designed with best practices for production environments.

Overview

This project is structured to support a robust Airflow implementation, including:

  • DAGs: Core workflow definitions.
  • Plugins: Custom operators, hooks, and sensors.
  • Tests: Unit and integration tests for DAGs and plugins.
  • Configuration: Environment-specific settings.
  • Documentation: Detailed information about the DAGs and their usage.

Getting Started

Prerequisites

  • Apache Airflow 2.x
  • Python 3.8+

Installation

  1. Clone this repository.
  2. Copy the contents of the dags, plugins, and config directories to your Airflow environment.

Usage

Detailed usage instructions are available in the docs directory.

Contributing

Contributions are welcome! Please follow the guidelines in CONTRIBUTING.md.

License

This project is licensed under the MIT License - see the LICENSE file for details.

About

This repository offers a robust collection of complex and reusable Apache Airflow DAGs, meticulously crafted for production environments. It lays down a solid foundation for your data orchestration and MLOps pipeliness

Resources

License

Contributing

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages