Description
The handbook identifies scalability tests as a special high-risk test category that requires monitoring. Currently, signalhound does not have special handling for scalability tests.
The following scalability jobs/tests could regress quite easily (due to seemingly unrelated PRs anywhere in the k8s codebase) and require constant manual monitoring/triaging and domain expertise to investigate and resolve.
master-blocking gce-cos-master-scalability-100
master-informing gce-scale-correctness
master-informing gce-scale-performance
release-x.y-blocking gce-cos-x.y-scalability-100
Requirements
- Identify scalability tests from test names or categories
- Apply special monitoring rules for scalability tests
- Highlight scalability test failures in reports
- Support scalability test-specific thresholds
Acceptance Criteria
Implementation Notes
- Detect scalability tests from test names (e.g., "scale", "load", "performance")
- Apply higher priority or special handling
- Add scalability test category to reports
Description
The handbook identifies scalability tests as a special high-risk test category that requires monitoring. Currently, signalhound does not have special handling for scalability tests.
The following scalability jobs/tests could regress quite easily (due to seemingly unrelated PRs anywhere in the k8s codebase) and require constant manual monitoring/triaging and domain expertise to investigate and resolve.
master-blocking gce-cos-master-scalability-100
master-informing gce-scale-correctness
master-informing gce-scale-performance
release-x.y-blocking gce-cos-x.y-scalability-100
Requirements
Acceptance Criteria
Implementation Notes