Skip to content

Added alarm for splunk s3 backup for delivery failures#495

Merged
robbailiff2 merged 6 commits intomainfrom
feature/rgjb-eli-486-cloudwatch_alarm_for_splunk_backup_s3_failures
Dec 17, 2025
Merged

Added alarm for splunk s3 backup for delivery failures#495
robbailiff2 merged 6 commits intomainfrom
feature/rgjb-eli-486-cloudwatch_alarm_for_splunk_backup_s3_failures

Conversation

@robbailiff2
Copy link
Contributor

Description

Context

Type of changes

  • Refactoring (non-breaking change)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would change existing functionality)
  • Bug fix (non-breaking change which fixes an issue)

Checklist

  • I am familiar with the contributing guidelines
  • I have followed the code style of the project
  • I have added tests to cover my changes
  • I have updated the documentation accordingly
  • This PR is a result of pair or mob programming

Sensitive Information Declaration

To ensure the utmost confidentiality and protect your and others privacy, we kindly ask you to NOT including PII (Personal Identifiable Information) / PID (Personal Identifiable Data) or any other sensitive data in this PR (Pull Request) and the codebase changes. We will remove any PR that do contain any sensitive information. We really appreciate your cooperation in this matter.

  • I confirm that neither PII/PID nor sensitive data are included in this PR and the codebase changes.

@eddalmond1
Copy link
Collaborator

I think this looks good - assuming terraform plan etc. worked ok :D

@robbailiff2
Copy link
Contributor Author

Terraform changes:

Terraform will perform the following actions:

  # aws_cloudwatch_metric_alarm.splunk_backup_delivery_failure will be created
  + resource "aws_cloudwatch_metric_alarm" "splunk_backup_delivery_failure" {
      + actions_enabled                       = true
      + alarm_actions                         = [
          + "arn:aws:sns:eu-west-2:448049830832:cloudwatch-security-alarms",
        ]
      + alarm_description                     = "Triggers when there is a delivery failure from Firehose to the Splunk backup S3 bucket"
      + alarm_name                            = "SplunkBackupS3DeliveryFailure"
      + arn                                   = (known after apply)
      + comparison_operator                   = "GreaterThanThreshold"
      + dimensions                            = {
          + "DeliveryStreamName" = "splunk-alarm-events"
        }
      + evaluate_low_sample_count_percentiles = (known after apply)
      + evaluation_periods                    = 1
      + id                                    = (known after apply)
      + metric_name                           = "BackupToS3.Records"
      + namespace                             = "AWS/Firehose"
      + period                                = 300
      + statistic                             = "Sum"
      + tags                                  = {
          + "AlertType"   = "data-delivery"
          + "Environment" = "dev"
          + "ManagedBy"   = "terraform"
          + "Service"     = "firehose"
          + "Severity"    = "high"
        }
      + tags_all                              = {
          + "AlertType"           = "data-delivery"
          + "ApplicationRole"     = "API"
          + "CostCentre"          = "129117"
          + "Customer"            = "NHS England"
          + "DataType"            = "PII"
          + "Environment"         = "dev"
          + "FinOpsTagVersion"    = "1"
          + "ManagedBy"           = "terraform"
          + "OnOffPattern"        = "AlwaysOn"
          + "Owner"               = "edd.almond1@nhs.net"
          + "Product"             = "EligibilitySignpostingAPI"
          + "Programme"           = "Vaccinations"
          + "ProjectType"         = "Production"
          + "PublicFacing"        = "Y"
          + "Service"             = "firehose"
          + "ServiceCategory"     = "Silver"
          + "Severity"            = "high"
          + "Stack"               = "api-layer"
          + "Tool"                = "Terraform"
          + "data_classification" = "5"
          + "workspace"           = "default"
        }
      + threshold                             = 0
      + treat_missing_data                    = "notBreaching"
    }

Plan: 1 to add, 0 to change, 0 to destroy.

@robbailiff2 robbailiff2 merged commit eba1960 into main Dec 17, 2025
25 checks passed
@robbailiff2 robbailiff2 deleted the feature/rgjb-eli-486-cloudwatch_alarm_for_splunk_backup_s3_failures branch December 17, 2025 14:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants