Skip to content

Feat: Automatic Priority Label Assignment #25

@knabben

Description

@knabben

Description

The Release Signal handbook defines specific priority labels (priority/critical-urgent, priority/important-soon, priority/important-longterm) based on test failure patterns and flake rates. Currently, all issues require manual priority assignment.

Requirements

  • Implement priority assignment logic based on handbook criteria:
    • priority/critical-urgent: Consistently failing tests, >20% flake rate in blocking dashboards
    • priority/important-soon: >2% flake rate in blocking jobs, failures in informing jobs
    • priority/important-longterm: Lower urgency issues
  • Calculate flake rates from TestGrid or Triage data
  • Automatically add priority labels to generated issues
  • Support manual override if needed

Acceptance Criteria

  • Priority labels are automatically assigned based on failure patterns
  • Flake rate calculation works for blocking and informing dashboards
  • Priority labels are included in GitHub issue creation
  • Priority assignment logic matches handbook criteria
  • Unit tests for priority assignment logic
  • Integration tests with real test data

Implementation Notes

  • Calculate flake rate: flake_count / total_runs
  • Check if dashboard is blocking or informing
  • Consider failure count and consistency
  • Default to priority/critical-urgent if uncertain (per handbook)

Metadata

Metadata

Assignees

No one assigned

    Labels

    lifecycle/rottenDenotes an issue or PR that has aged beyond stale and will be auto-closed.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions