Skip to content

Feat: Special Monitoring for Scalability Tests #34

@knabben

Description

@knabben

Description

The handbook identifies scalability tests as a special high-risk test category that requires monitoring. Currently, signalhound does not have special handling for scalability tests.

The following scalability jobs/tests could regress quite easily (due to seemingly unrelated PRs anywhere in the k8s codebase) and require constant manual monitoring/triaging and domain expertise to investigate and resolve.

master-blocking gce-cos-master-scalability-100
master-informing gce-scale-correctness
master-informing gce-scale-performance
release-x.y-blocking gce-cos-x.y-scalability-100

Requirements

  • Identify scalability tests from test names or categories
  • Apply special monitoring rules for scalability tests
  • Highlight scalability test failures in reports
  • Support scalability test-specific thresholds

Acceptance Criteria

  • Scalability tests are identified
  • Special monitoring is applied to scalability tests
  • Scalability test failures are highlighted in reports
  • Configurable thresholds for scalability tests
  • Unit tests for scalability test detection
  • Integration tests with scalability test data

Implementation Notes

  • Detect scalability tests from test names (e.g., "scale", "load", "performance")
  • Apply higher priority or special handling
  • Add scalability test category to reports

Metadata

Metadata

Assignees

No one assigned

    Labels

    lifecycle/staleDenotes an issue or PR has remained open with no activity and has become stale.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions