Skip to content

Feat: Special Monitoring for Scalability Tests #34

@knabben

Description

@knabben

Description

The handbook identifies scalability tests as a special high-risk test category that requires monitoring. Currently, signalhound does not have special handling for scalability tests.

The following scalability jobs/tests could regress quite easily (due to seemingly unrelated PRs anywhere in the k8s codebase) and require constant manual monitoring/triaging and domain expertise to investigate and resolve.

master-blocking gce-cos-master-scalability-100
master-informing gce-scale-correctness
master-informing gce-scale-performance
release-x.y-blocking gce-cos-x.y-scalability-100

Requirements

  • Identify scalability tests from test names or categories
  • Apply special monitoring rules for scalability tests
  • Highlight scalability test failures in reports
  • Support scalability test-specific thresholds

Acceptance Criteria

  • Scalability tests are identified
  • Special monitoring is applied to scalability tests
  • Scalability test failures are highlighted in reports
  • Configurable thresholds for scalability tests
  • Unit tests for scalability test detection
  • Integration tests with scalability test data

Implementation Notes

  • Detect scalability tests from test names (e.g., "scale", "load", "performance")
  • Apply higher priority or special handling
  • Add scalability test category to reports

Metadata

Metadata

Assignees

No one assigned

    Labels

    lifecycle/rottenDenotes an issue or PR that has aged beyond stale and will be auto-closed.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions