Skip to content
This repository was archived by the owner on Jul 16, 2024. It is now read-only.

Implement a Dwh construct to abstract Redshift and helpers #392

@vgkowski

Description

@vgkowski

Currently, there is no Dwh abstraction in the Analytics Reference Architecture and you need to provision Redshift L2 Construct with lots of additional resources to get a complete and usable setup.

We can implement a new construct called Dwh which bundle all the required resources with defaults but still customizable. It can be composed of:

  • Redshift cluster with a default parameter group (multiple priority queues, concurrency scaling,
  • KMS key for data encryption
  • Bucket for logs (should be an AraBucket singleton 'redshift-access-logs')
  • Default WLM configuration
  • IAM role for Spectrum
  • Schema pointing to Glue catalog
  • Default users for ETL, data engineer, data analyst, data scientist

Points to be investigated:

  • L2 alpha versus L1 Cfn based construct
  • Need for SSL enforcement
  • IAM authentication vs secret manager username/password

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestredshiftComponents used in Redshift abstractions

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions