Skip to content

Conversation

@khalford
Copy link
Member

I would suggest reviewers review commit-by-commit rather than the entire file diff

ChatOps services major deployment adds the following:

  • Systemd exporter play to configure systemd-exporter for all hosts
  • Add CAdvisor for ChatOps containers monitoring rather than the internal docker metrics endpoint
  • Add Elastic stack VM in Terraform
    -Add Elasticsearch play
  • Add Kibana play
  • Add Logstash play
  • Add filebeat to all hosts for all services to send their logs into logstash

@khalford khalford self-assigned this May 16, 2025
@khalford khalford force-pushed the more_monitoring branch 7 times, most recently from b3acb26 to b622f4b Compare May 23, 2025 08:01
@khalford khalford force-pushed the more_monitoring branch 4 times, most recently from 6bfca13 to 4274701 Compare June 3, 2025 09:22
Adding a new VM to the Terraform configuration to host the Elastic "ELK"
stack. Also, creates security groups for the correct ports needed by
this service and attaches a volume to the VM to be used as persistent database
storage.
khalford added 5 commits June 4, 2025 10:42
Downloads the Elasticsearch binaries and copies the systemd unit file to
run Elasticsearch as a service.
Adding a play to install and configure Kibana on the Elastic Stack host.
This sets up a systemd service. Also, adds kibana.domain.. to the
certbot certificate generation and adds a kibana backend to the HAProxy
config.
Install and set up logstash on the elastic stack host. Creates a systemd
service for logstash and adds the filter that adds extra fields into the
chatops logs.
Set up the Elastic, kibana and logstash user passwords to what we have
saved as variables. This is required for the first time set up but also
allows us to easily rotate the passwords if needed.
Adding the elastic stack system passwords to the monitoring vault
@khalford khalford closed this Jun 4, 2025
@khalford khalford deleted the more_monitoring branch June 6, 2025 08:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants