The BigData Republic Open Data Platform is a repository of Terraform templates that help to deploy a modern, open-source data platform on European cloud providers. The platform follows open data stack principles to promote interoperability and avoid vendor lock‑in.
The Open Data Stack is a collection of open-source tools and open standards that together support the full data engineering lifecycle — enabling scalable, flexible, and cost‑effective data platforms without proprietary constraints.
This project helps organizations experiment with running a data platform on European cloud infrastructure and achieve a first working deployment within a single day.
It is an opinionated starting point. Many production concerns are intentionally out of scope for now, including:
- Network security hardening
- Authentication & authorization (IAM / SSO)
- Streaming / real‑time ingestion
- Backup, disaster recovery, and lifecycle policies
- Cost governance & observability
Currently supported deployment targets:
Local Kubernetes deployment is also supported for development and experimentation.
The solution consists of two layers:
- Infrastructure provisioning (cloud + local) via Terraform
- Data platform deployment via Terraform + Helm on the provisioned Kubernetes cluster
The infrastructure layer provisions the core building blocks:
- Object storage
- Kubernetes cluster
Each cloud integration lives under infra/<provider> and implements the provider‑specific provisioning logic. Depending on the provider, resources are created either through direct Terraform providers (e.g. Scaleway) or via OpenStack APIs plus kubectl (e.g. Cyso Cloud). A local option is also available for testing.
Refer to the provider documentation for setup instructions:
- Local Infrastructure Deployment
- Cyso Cloud Infrastructure Deployment
- Scaleway Infrastructure Deployment
The proof‑of‑concept data platform assembles a lean but capable open-source stack:
Trino is configured to persist datasets as Apache Iceberg tables in object storage via the Nessie catalog.
Deployment steps are provider‑agnostic; see the platform deployment guide here.
Released under the MIT License.