Repository navigation
ci: run workflows on the CodeBuild runner - #158
Merged
Merged
Conversation
yaythomas
temporarily deployed
to
ai-pr-review-runtime
November 6, 2026 18:22 — with
GitHub Actions
Inactive
On 2026-11-05, jobs waited up to 94 minutes for a GitHub-hosted runner, while the JS and Python SDKs' jobs on the CodeBuild-hosted runner started in under two minutes. This builds on #75, which moved the four workflows to that runner, rebases it onto main and addresses its review comments: - ci.yml and codeql.yml run fork and Dependabot pull requests on ubuntu-latest, so a dependency update's build scripts and procedural macros do not run in the CodeBuild account before review. Everything else runs on the CodeBuild runner. - cloud-tests.yml and conformance-tests.yml skip fork and Dependabot pull requests, which cannot read the test secrets. - Every job times out before the CodeBuild build limit, the jobs that deploy stacks soonest, so that their own teardown step can finish. A teardown job in each AWS workflow deletes the stacks by name on a fresh runner, also when CodeBuild stops a test runner. The cloud-tests concurrency group moves to the workflow, so a run deletes its stacks before the next run deploys stacks of the same names. - check (sdk) asks for the large instance: on the default one, the kernel killed the rustc that compiles the unit tests. - The action ensure-rustup installs a pinned, checksummed rustup-init where rustup is missing. free-disk-space runs only on GitHub-hosted runners. Co-authored-by: Alex Wang <wangyb@amazon.com>
yaythomas
force-pushed
the
ci/codebuild-runners
branch
from
November 6, 2026 19:01
8933fb3 to
a14d975
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Builds on #75 by @wangyb-A: it moves CI, CodeQL, the cloud tests and the conformance tests to the CodeBuild-hosted runner. This branch rebases that change onto main and addresses both review comments on #75. The second commit of #75 (clippy fixes for Rust 1.99) is not needed, because main already passes on current stable.
Why
On 2026-11-05, jobs on GitHub-hosted runners waited up to 94 minutes for a runner. The same day, the jobs on the CodeBuild runner in the JS and Python repositories started within two minutes, half of them within 30 seconds.
What changes
ci.ymlandcodeql.yml: pushes, the CodeQL schedule and same-repository pull requests run oncodebuild-github-actions-runner-<run_id>-<attempt>. Fork and Dependabot pull requests run onubuntu-latest, with the expression of ci: run all workflows on CodeBuild runner aws-durable-execution-sdk-python#747.cloud-tests.ymlandconformance-tests.yml: fork and Dependabot pull requests skip every job, because the jobs need secrets those runs cannot read. All other jobs run on the CodeBuild runner..github/actions/ensure-rustup(from ci: run CI, cloud tests, conformance and CodeQL on the CodeBuild runner #75) runs before everyrustupcall and installs a pinned, sha256-verified rustup-init where rustup is missing, as on the CodeBuild image.free-disk-spaceruns only on GitHub-hosted runners.check (sdk)asks for the large instance (label suffix-large, 16 GiB, asubuntu-latesthas). On the project's default instance, the kernel killed the rustc that compiles the SDK's unit tests in the first run of this pull request; that rustc alone peaks above 7 GiB.Review comments on #75
ci.ymlandcodeql.ymljob, and to the skip condition of the cloud and conformance jobs.mainruns, the longest job took 17.5 minutes (example-tests), and stack deletion took at most 3.6 minutes (cloud) and 6.6 minutes (conformancewait), so the in-job teardown step fits before the limit. A timeout cannot help when CodeBuild stops the runner for another reason, so each AWS workflow also gets a teardown job thatneedsthe tests, runs withif: always()on a fresh runner, and deletes the stacks by name. The cloud-tests concurrency group moves from the job to the workflow, so a run's teardown finishes before the next run deploys the same stack names. Fork and Dependabot runs take a group of their own, so they cannot cancel a waiting run.Verification
All four workflows run on this pull request. Every job should show a
codebuild-github-actions-runner-…label, start within a few minutes and pass, and the two teardown jobs should find no stacks left to delete.