Skip to content

Conversation

@MartinNikov
Copy link
Contributor

@MartinNikov MartinNikov commented Feb 5, 2025

Service Overview: Randomized Alert Loop

This service operates in an infinite loop, triggering alerts at randomized intervals within a defined range.

  • Timing:

    • Minimum wait time: 1 hour (default)
    • Maximum wait time: 4 hours (default)
    • After the minimum wait, a random time within the remaining window is chosen for the next alert.
  • Alert Behavior:

    • Alerts are triggered via curl to a specified Alertmanager URL.
    • Alerts last for a configurable duration (default: 1 hour).
    • Alerts auto-resolve after the duration ends.
  • Logging Options:

    • info: Logs when an alert is sent and its success status.
    • debug: Also logs the scheduled time for the next alert.

🚨 Default Configuration: 6 Alerts per 24 Hours 🚨

@Xearty
Copy link
Contributor

Xearty commented Feb 6, 2025

I dislike the regularity of the random alerts. As they are right now, they are very predictable as there are certain invariants in place. There are gaps that are guaranteed to not have alerts in them. Could you explain the purpose and reasoning behind this design?

@Xearty Xearty self-requested a review February 6, 2025 12:25
Xearty
Xearty previously requested changes Feb 6, 2025
Copy link
Contributor

@Xearty Xearty left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

check comments

@github-actions
Copy link
Contributor

Thanks for your Pull Request!

Below you will find a summary of the cachix status of each package, for each supported platform.

package x86_64-linux x86_64-darwin aarch64-darwin
cachix ❌ build failed ❌ build failed ❌ build failed
dcd ✅ cached 🚫 not supported 🚫 not supported
dmd ✅ cached 🚫 not supported 🚫 not supported
dscanner ✅ cached 🚫 not supported 🚫 not supported
dub ✅ cached ✅ cached ✅ cached
folder-size-metrics ✅ cached 🚫 not supported 🚫 not supported
foundry ✅ cached ✅ cached ✅ cached
geth ✅ cached 🚫 not supported ✅ cached
grafana-agent ✅ cached 🚫 not supported ✅ cached
ldc ✅ cached 🚫 not supported 🚫 not supported
lido-withdrawals-automation ✅ cached ✅ cached ✅ cached
mcl ✅ cached 🚫 not supported 🚫 not supported
mev-boost ✅ cached 🚫 not supported 🚫 not supported
nethermind ✅ cached 🚫 not supported 🚫 not supported
nimbus ✅ cached 🚫 not supported 🚫 not supported
nix ❌ build failed ❌ build failed ❌ build failed
nix-eval-jobs ❌ build failed ❌ build failed ❌ build failed
nix-fast-build ❌ build failed ❌ build failed ❌ build failed
pyroscope ✅ cached ✅ cached ✅ cached
random-alerts ✅ cached ✅ cached ✅ cached
rustToolchain ✅ cached ✅ cached ✅ cached
serve-d ✅ cached 🚫 not supported 🚫 not supported
terraform ✅ cached 🚫 not supported 🚫 not supported
terranix ✅ cached 🚫 not supported 🚫 not supported
validator-ejector ✅ cached 🚫 not supported 🚫 not supported
web3signer ✅ cached 🚫 not supported 🚫 not supported

@PetarKirov PetarKirov dismissed Xearty’s stale review February 12, 2025 08:25

Requested changes were made, tnx for the review!

@PetarKirov PetarKirov merged commit b464dea into main Feb 12, 2025
27 checks passed
@PetarKirov PetarKirov deleted the feat/random-alerts branch February 12, 2025 08:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants