Skip to content

Commit c442243

Browse files
committed
Replace rundeck with airflow
1 parent 7a71b78 commit c442243

File tree

29 files changed

+200
-204
lines changed

29 files changed

+200
-204
lines changed

docs/liberty/technical/architecture.md

Lines changed: 21 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
This document provides an overview of the functionality and configuration of the services within the **Liberty Framework**, including **Node.js**, **PostgreSQL**, **pgAdmin**, **Rundeck**, **OIDC**, and **Filebrowser**. These services are integrated with **Traefik** as a reverse proxy, enabling both HTTP and HTTPS access with automated routing.
1+
This document provides an overview of the functionality and configuration of the services within the **Liberty Framework**, including **Node.js**, **PostgreSQL**, **pgAdmin**, **Airflow**, **OIDC**, and **Gitea**. These services are integrated with **Traefik** as a reverse proxy, enabling both HTTP and HTTPS access with automated routing.
22

33
---
44

@@ -52,21 +52,20 @@ This document provides an overview of the functionality and configuration of the
5252

5353
---
5454

55-
## 4. **Rundeck Service (`liberty-rundeck`)** 🛠️
55+
## 4. **Airflow Service (`liberty-airflow`)** 🛠️
5656

57-
- **Image**: `ghcr.io/fblettner/liberty-rundeck:latest`
57+
- **Image**: `ghcr.io/fblettner/liberty-airflow:latest`
5858
- **Security Options**:
5959
- 🔒 Disables SELinux labels.
6060
- ⚙️ Drops capabilities `MKNOD` and `AUDIT_WRITE`.
6161
- **Volumes**:
62-
- Data stored in the `rundeck-data` volume.
63-
- Configurations in `rundeck-config` and `talend-config`.
64-
- **Depends on**: PostgreSQL (`pg`).
62+
- Logs stored in the `airflow-logs` volume.
63+
- **Depends on**: PostgreSQL (`pg`), Gitea (`gitea`).
6564
- **Networks**: Connected to `liberty-network`.
6665
- **Traefik Configuration**:
67-
- 🌐 **Routing**: Handles HTTP and HTTPS requests for `/rundeck`.
66+
- 🌐 **Routing**: Handles HTTP and HTTPS requests for `/airflow/home`.
6867
- ⚠️ **Error Pages Middleware**: Applied to both HTTP and HTTPS routes.
69-
- 🔌 **Port**: Exposed on port `4440`.
68+
- 🔌 **Port**: Exposed on port `8080`.
7069

7170
---
7271

@@ -86,32 +85,31 @@ This document provides an overview of the functionality and configuration of the
8685

8786
---
8887

89-
## 6. **Filebrowser Service (`liberty-filebrowser`)** 📂
88+
## 6. **Gitea Service (`liberty-gitea`)** 📂
9089

91-
- **Image**: `ghcr.io/fblettner/liberty-filebrowser:latest`
92-
- **Healthcheck**: Ensures service health by checking `/health` endpoint every 30 seconds.
90+
- **Image**: `ghcr.io/fblettner/liberty-gitea:latest`
91+
- **Healthcheck**: Ensures service health by checking `/` endpoint every 30 seconds.
9392
- **Volumes**:
94-
- Configuration in `fb-config` and data in `fb-data`.
95-
- Shares Rundeck, Talend, Traefik certificates, and configuration via other volumes.
93+
- Configuration and data in `liberty-gitea`.
9694
- **Restart Policy**: Set to `unless-stopped`.
9795
- **Networks**: Connected to `liberty-network`.
9896
- **Traefik Configuration**:
99-
- 🌐 **Routing**: Routes HTTP requests to `/filebrowser`.
100-
- 🛠️ **Middleware**: Uses `stripprefix` to remove `/filebrowser` from the path for internal routing.
101-
- 🔌 **Port**: Exposed on port `80`.
97+
- 🌐 **Routing**: Routes HTTP requests to `/gitea`.
98+
- 🛠️ **Middleware**: Uses `stripprefix` to remove `/gitea` from the path for internal routing.
99+
- 🔌 **Port**: Exposed on port `3000`.
102100

103101
---
104102

105103
## Volumes 🗃️
106104

107-
- **fb-config**: Stores Filebrowser configuration.
108-
- **fb-data**: Stores Filebrowser data.
105+
- **node-logs**: Stores Logs for backend and frontend.
109106
- **pg-data**: Stores PostgreSQL data.
107+
- **pg-logs**: Stores Logs for database.
110108
- **pgadmin-data**: Stores pgAdmin data.
111-
- **rundeck-data**: Stores Rundeck data.
112-
- **rundeck-config**: Stores Rundeck configuration.
113-
- **talend-config**: Stores Talend configuration.
114-
- **nginx-config**: Stores Nginx configuration.
109+
- **liberty-gitea**: Stores gitea config and data.
110+
- **airflow-logs**: Stores logs for Airflow.
111+
- **airflow-dags**: Stores Dags for Airflow.
112+
- **airflow-plugins**: Stores Plugins for Airflow.
115113
- **traefik-certs**: Stores Traefik certificates (external).
116114
- **traefik-config**: Stores Traefik configuration (external).
117115
- **shared-data**: Stores shared data (external).
@@ -124,4 +122,4 @@ This document provides an overview of the functionality and configuration of the
124122

125123
---
126124

127-
This configuration enables a scalable, containerized microservice architecture with **Node.js** for application logic, **PostgreSQL** for database management, **pgAdmin** for database administration, **Rundeck** for automation, **Keycloak OIDC** for authentication, and **Filebrowser** for file management. **Traefik** serves as the reverse proxy, handling routing and applying security middleware for all services.
125+
This configuration enables a scalable, containerized microservice architecture with **Node.js** for application logic, **PostgreSQL** for database management, **pgAdmin** for database administration, **Airflow** for automation, **Keycloak OIDC** for authentication, and **Gitea** for file management and versioning. **Traefik** serves as the reverse proxy, handling routing and applying security middleware for all services.

site/404.html

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@
1616

1717

1818

19-
<title>Documentation</title>
19+
<title>NOMANA-IT - Documentation, Blog and Resources</title>
2020

2121

2222

@@ -79,7 +79,7 @@
7979

8080
<header class="md-header" data-md-component="header">
8181
<nav class="md-header__inner md-grid" aria-label="Header">
82-
<a href="/." title="Documentation" class="md-header__button md-logo" aria-label="Documentation" data-md-component="logo">
82+
<a href="/." title="NOMANA-IT - Documentation, Blog and Resources" class="md-header__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
8383

8484
<img src="/assets/logo_ly.png" alt="logo">
8585

@@ -92,7 +92,7 @@
9292
<div class="md-header__ellipsis">
9393
<div class="md-header__topic">
9494
<span class="md-ellipsis">
95-
Documentation
95+
NOMANA-IT - Documentation, Blog and Resources
9696
</span>
9797
</div>
9898
<div class="md-header__topic" data-md-component="header-topic">
@@ -281,12 +281,12 @@
281281

282282
<nav class="md-nav md-nav--primary md-nav--lifted" aria-label="Navigation" data-md-level="0">
283283
<label class="md-nav__title" for="__drawer">
284-
<a href="/." title="Documentation" class="md-nav__button md-logo" aria-label="Documentation" data-md-component="logo">
284+
<a href="/." title="NOMANA-IT - Documentation, Blog and Resources" class="md-nav__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
285285

286286
<img src="/assets/logo_ly.png" alt="logo">
287287

288288
</a>
289-
Documentation
289+
NOMANA-IT - Documentation, Blog and Resources
290290
</label>
291291

292292
<ul class="md-nav__list" data-md-scrollfix>

site/api/bip-api/nomabc/index.html

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222

2323

2424

25-
<title>Simple JAVA CLASS to encode string and display barcode 128 with BI Publisher RTF template - Documentation</title>
25+
<title>Simple JAVA CLASS to encode string and display barcode 128 with BI Publisher RTF template - NOMANA-IT - Documentation, Blog and Resources</title>
2626

2727

2828

@@ -90,7 +90,7 @@
9090

9191
<header class="md-header" data-md-component="header">
9292
<nav class="md-header__inner md-grid" aria-label="Header">
93-
<a href="../../.." title="Documentation" class="md-header__button md-logo" aria-label="Documentation" data-md-component="logo">
93+
<a href="../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-header__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
9494

9595
<img src="../../../assets/logo_ly.png" alt="logo">
9696

@@ -103,7 +103,7 @@
103103
<div class="md-header__ellipsis">
104104
<div class="md-header__topic">
105105
<span class="md-ellipsis">
106-
Documentation
106+
NOMANA-IT - Documentation, Blog and Resources
107107
</span>
108108
</div>
109109
<div class="md-header__topic" data-md-component="header-topic">
@@ -294,12 +294,12 @@
294294

295295
<nav class="md-nav md-nav--primary md-nav--lifted" aria-label="Navigation" data-md-level="0">
296296
<label class="md-nav__title" for="__drawer">
297-
<a href="../../.." title="Documentation" class="md-nav__button md-logo" aria-label="Documentation" data-md-component="logo">
297+
<a href="../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-nav__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
298298

299299
<img src="../../../assets/logo_ly.png" alt="logo">
300300

301301
</a>
302-
Documentation
302+
NOMANA-IT - Documentation, Blog and Resources
303303
</label>
304304

305305
<ul class="md-nav__list" data-md-scrollfix>

site/api/bip-api/nomabip/index.html

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222

2323

2424

25-
<title>JAVA package with Oracle BI Publisher API - Documentation</title>
25+
<title>JAVA package with Oracle BI Publisher API - NOMANA-IT - Documentation, Blog and Resources</title>
2626

2727

2828

@@ -90,7 +90,7 @@
9090

9191
<header class="md-header" data-md-component="header">
9292
<nav class="md-header__inner md-grid" aria-label="Header">
93-
<a href="../../.." title="Documentation" class="md-header__button md-logo" aria-label="Documentation" data-md-component="logo">
93+
<a href="../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-header__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
9494

9595
<img src="../../../assets/logo_ly.png" alt="logo">
9696

@@ -103,7 +103,7 @@
103103
<div class="md-header__ellipsis">
104104
<div class="md-header__topic">
105105
<span class="md-ellipsis">
106-
Documentation
106+
NOMANA-IT - Documentation, Blog and Resources
107107
</span>
108108
</div>
109109
<div class="md-header__topic" data-md-component="header-topic">
@@ -294,12 +294,12 @@
294294

295295
<nav class="md-nav md-nav--primary md-nav--lifted" aria-label="Navigation" data-md-level="0">
296296
<label class="md-nav__title" for="__drawer">
297-
<a href="../../.." title="Documentation" class="md-nav__button md-logo" aria-label="Documentation" data-md-component="logo">
297+
<a href="../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-nav__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
298298

299299
<img src="../../../assets/logo_ly.png" alt="logo">
300300

301301
</a>
302-
Documentation
302+
NOMANA-IT - Documentation, Blog and Resources
303303
</label>
304304

305305
<ul class="md-nav__list" data-md-scrollfix>

site/api/getting-started/index.html

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222

2323

2424

25-
<title>Getting started - Documentation</title>
25+
<title>Getting started - NOMANA-IT - Documentation, Blog and Resources</title>
2626

2727

2828

@@ -90,7 +90,7 @@
9090

9191
<header class="md-header" data-md-component="header">
9292
<nav class="md-header__inner md-grid" aria-label="Header">
93-
<a href="../.." title="Documentation" class="md-header__button md-logo" aria-label="Documentation" data-md-component="logo">
93+
<a href="../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-header__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
9494

9595
<img src="../../assets/logo_ly.png" alt="logo">
9696

@@ -103,7 +103,7 @@
103103
<div class="md-header__ellipsis">
104104
<div class="md-header__topic">
105105
<span class="md-ellipsis">
106-
Documentation
106+
NOMANA-IT - Documentation, Blog and Resources
107107
</span>
108108
</div>
109109
<div class="md-header__topic" data-md-component="header-topic">
@@ -294,12 +294,12 @@
294294

295295
<nav class="md-nav md-nav--primary md-nav--lifted" aria-label="Navigation" data-md-level="0">
296296
<label class="md-nav__title" for="__drawer">
297-
<a href="../.." title="Documentation" class="md-nav__button md-logo" aria-label="Documentation" data-md-component="logo">
297+
<a href="../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-nav__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
298298

299299
<img src="../../assets/logo_ly.png" alt="logo">
300300

301301
</a>
302-
Documentation
302+
NOMANA-IT - Documentation, Blog and Resources
303303
</label>
304304

305305
<ul class="md-nav__list" data-md-scrollfix>

site/api/jde-api/jdebip/index.html

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222

2323

2424

25-
<title>Export XML source or PDF Output from JD Edwards BLOB fields - Documentation</title>
25+
<title>Export XML source or PDF Output from JD Edwards BLOB fields - NOMANA-IT - Documentation, Blog and Resources</title>
2626

2727

2828

@@ -90,7 +90,7 @@
9090

9191
<header class="md-header" data-md-component="header">
9292
<nav class="md-header__inner md-grid" aria-label="Header">
93-
<a href="../../.." title="Documentation" class="md-header__button md-logo" aria-label="Documentation" data-md-component="logo">
93+
<a href="../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-header__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
9494

9595
<img src="../../../assets/logo_ly.png" alt="logo">
9696

@@ -103,7 +103,7 @@
103103
<div class="md-header__ellipsis">
104104
<div class="md-header__topic">
105105
<span class="md-ellipsis">
106-
Documentation
106+
NOMANA-IT - Documentation, Blog and Resources
107107
</span>
108108
</div>
109109
<div class="md-header__topic" data-md-component="header-topic">
@@ -294,12 +294,12 @@
294294

295295
<nav class="md-nav md-nav--primary md-nav--lifted" aria-label="Navigation" data-md-level="0">
296296
<label class="md-nav__title" for="__drawer">
297-
<a href="../../.." title="Documentation" class="md-nav__button md-logo" aria-label="Documentation" data-md-component="logo">
297+
<a href="../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-nav__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
298298

299299
<img src="../../../assets/logo_ly.png" alt="logo">
300300

301301
</a>
302-
Documentation
302+
NOMANA-IT - Documentation, Blog and Resources
303303
</label>
304304

305305
<ul class="md-nav__list" data-md-scrollfix>

site/api/jde-api/jdebsfn/index.html

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222

2323

2424

25-
<title>Export source code for BSFN from JD Edwards BLOB field (F98780R) - Documentation</title>
25+
<title>Export source code for BSFN from JD Edwards BLOB field (F98780R) - NOMANA-IT - Documentation, Blog and Resources</title>
2626

2727

2828

@@ -90,7 +90,7 @@
9090

9191
<header class="md-header" data-md-component="header">
9292
<nav class="md-header__inner md-grid" aria-label="Header">
93-
<a href="../../.." title="Documentation" class="md-header__button md-logo" aria-label="Documentation" data-md-component="logo">
93+
<a href="../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-header__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
9494

9595
<img src="../../../assets/logo_ly.png" alt="logo">
9696

@@ -103,7 +103,7 @@
103103
<div class="md-header__ellipsis">
104104
<div class="md-header__topic">
105105
<span class="md-ellipsis">
106-
Documentation
106+
NOMANA-IT - Documentation, Blog and Resources
107107
</span>
108108
</div>
109109
<div class="md-header__topic" data-md-component="header-topic">
@@ -294,12 +294,12 @@
294294

295295
<nav class="md-nav md-nav--primary md-nav--lifted" aria-label="Navigation" data-md-level="0">
296296
<label class="md-nav__title" for="__drawer">
297-
<a href="../../.." title="Documentation" class="md-nav__button md-logo" aria-label="Documentation" data-md-component="logo">
297+
<a href="../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-nav__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
298298

299299
<img src="../../../assets/logo_ly.png" alt="logo">
300300

301301
</a>
302-
Documentation
302+
NOMANA-IT - Documentation, Blog and Resources
303303
</label>
304304

305305
<ul class="md-nav__list" data-md-scrollfix>

site/blog/2024/11/21/database-size/index.html

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -22,7 +22,7 @@
2222

2323

2424

25-
<title>Database size - Documentation</title>
25+
<title>Database size - NOMANA-IT - Documentation, Blog and Resources</title>
2626

2727

2828

@@ -90,7 +90,7 @@
9090

9191
<header class="md-header" data-md-component="header">
9292
<nav class="md-header__inner md-grid" aria-label="Header">
93-
<a href="../../../../.." title="Documentation" class="md-header__button md-logo" aria-label="Documentation" data-md-component="logo">
93+
<a href="../../../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-header__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
9494

9595
<img src="../../../../../assets/logo_ly.png" alt="logo">
9696

@@ -103,7 +103,7 @@
103103
<div class="md-header__ellipsis">
104104
<div class="md-header__topic">
105105
<span class="md-ellipsis">
106-
Documentation
106+
NOMANA-IT - Documentation, Blog and Resources
107107
</span>
108108
</div>
109109
<div class="md-header__topic" data-md-component="header-topic">
@@ -296,12 +296,12 @@
296296

297297
<nav class="md-nav md-nav--primary md-nav--lifted" aria-label="Navigation" data-md-level="0">
298298
<label class="md-nav__title" for="__drawer">
299-
<a href="../../../../.." title="Documentation" class="md-nav__button md-logo" aria-label="Documentation" data-md-component="logo">
299+
<a href="../../../../.." title="NOMANA-IT - Documentation, Blog and Resources" class="md-nav__button md-logo" aria-label="NOMANA-IT - Documentation, Blog and Resources" data-md-component="logo">
300300

301301
<img src="../../../../../assets/logo_ly.png" alt="logo">
302302

303303
</a>
304-
Documentation
304+
NOMANA-IT - Documentation, Blog and Resources
305305
</label>
306306

307307
<ul class="md-nav__list" data-md-scrollfix>

0 commit comments

Comments
 (0)