Skip to content

ci: run affected suites and guide meaningful test coverage - #14

Merged
lukasoppermann merged 3 commits into
mainfrom
lukasoppermann-test-suite-efficiency
Oct 16, 2026
Merged

lukasoppermann merged 3 commits into
mainfrom
lukasoppermann-test-suite-efficiency

Conversation

@lukasoppermann

Copy link
Copy Markdown
Contributor

Why

Hub and build-action checks currently run for unrelated pull requests. Some existing assertions also repeat coverage or freeze visual implementation details rather than protect behavior.

What changes

Pull requests select whole Hub and build-action suites from their changed paths, including shared dependencies. Unknown paths run both suites, and pushes to main retain both complete suites. Existing required check names remain available, and the final checks reject failed selection or missing results. Dependency-age checks and the Starter and Learning workflows remain unchanged.

A shared test-writing skill asks agents to justify distinct regression coverage and use an independent test writer for substantial behavior changes and nontrivial fixes. The change also removes exact SVG-count assertions and repeated starter-content validation while retaining behavioral and copy checks.

Actual GitHub skipping and required-check reporting remain unverified. This PR should run both full suites because it changes workflows; a separate docs-only PR based on this branch is needed to exercise the skipped-suite path.

lukasoppermann and others added 2 commits October 16, 2026 10:04
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 9dd112c2-7eb9-443c-bc31-37cb9c3a663e
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 9dd112c2-7eb9-443c-bc31-37cb9c3a663e

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

Suite selection excludes starter inputs consumed by Hub, allowing local-setup regressions to bypass the relevant checks.

2 open findings
What changed in this PR

Reduces unrelated Hub and build-action CI work in Replica and introduces guidance for meaningful test coverage.

Changes:

  • Selects affected suites while preserving required check names and full suites on main.
  • Adds selector coverage and workflow-guard validation.
  • Adds test-writing guidance and removes redundant assertions.
File Description
scripts/​select-ci-suites.test.mjs Tests path selection, Git diffs, and CLI behavior.
scripts/​select-ci-suites.mjs Maps changed paths to affected suites.
scripts/​create-prototype-repo.test.mjs Removes repeated starter-content checks.
scripts/​check-ci-workflows.rb Validates workflow wiring and result guards.
hub/​docs/​testing-and-operations.md Explains conditional Hub CI execution.
hub/​app/​javascript/​pages/​welcome-page/​index.test.tsx Removes exact SVG-count assertions.
docs/​testing-and-review.md Documents test quality and suite selection.
AGENTS.md Links the test-writing skill.
.github/​workflows/​hub-ci.yml Gates Hub work on suite selection.
.github/​workflows/​ci-changes.yml Adds reusable suite selection.
.github/​workflows/​actions-ci.yml Gates build-action work and preserves its required check.
.github/​skills/​write-tests/​SKILL.md Adds contract-first test-writing guidance.

🧠 Review effort: Max


💡 Configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

Comment thread scripts/select-ci-suites.mjs Outdated
Comment thread scripts/select-ci-suites.test.mjs
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 9dd112c2-7eb9-443c-bc31-37cb9c3a663e
@lukasoppermann
lukasoppermann merged commit bae981d into main Oct 16, 2026
29 checks passed
@lukasoppermann
lukasoppermann deleted the lukasoppermann-test-suite-efficiency branch October 16, 2026 09:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants