Skip to content

[v3-4-test] Expose task instance loop pass and expansion size to listeners (#75132) - #75309

Merged
ashb merged 1 commit into
apache:v3-4-testfrom
kacpermuda:backport-75132-v3-4-test
Oct 21, 2026
Merged

ashb merged 1 commit into
apache:v3-4-testfrom
kacpermuda:backport-75132-v3-4-test

Conversation

@kacpermuda

@kacpermuda kacpermuda commented Oct 21, 2026 •

Copy link
Copy Markdown
Collaborator

Backport of #75132 to v3-4-test. The automatic backport failed because #75260 wasn't merged yet; with it in, this is a clean cherry-pick of the commit merged to main.


Was generative AI tooling used to co-author this PR?
  • Yes (Claude Code)

Generated-by: Claude Code (Opus 5.5) following the guidelines


  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst, in airflow-core/newsfragments. You can add this file in a follow-up commit after the PR is created so you know the PR number.

🤖 Generated with Claude Code

…eners (apache#75132)

A single event about a task instance should be enough to tell which execution it
describes: which loop pass and rerun of the loop it ran in, how many instances its
mapped expansion has, and why a loop gate stopped. Workers only had the loop
iteration, a mapped task inside a loop could not be tied to the pass it ran in,
reruns could only be ordered by comparing region ids from two events, and server
side consumers such as listeners had to read region rows to place a stored task
instance.
(cherry picked from commit e6a2c9f)

Co-authored-by: Claude <noreply@anthropic.com>
@kacpermuda
kacpermuda force-pushed the backport-75132-v3-4-test branch from 5c3deea to 9bbd16e Compare October 21, 2026 12:43
@kacpermuda
kacpermuda marked this pull request as ready for review October 21, 2026 12:43
@ashb
ashb merged commit 097b1be into apache:v3-4-test Oct 21, 2026
44 of 45 checks passed
@github-actions github-actions Bot added this to the Airflow 3.4.1 milestone Oct 21, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Hi maintainer, this PR was merged without a milestone set.
We've automatically set the milestone to Airflow 3.4.1 based on: merged to version branch
If this milestone is not correct, please update it to the appropriate milestone.

This comment was generated by Milestone Tag Assistant.

@kacpermuda
kacpermuda deleted the backport-75132-v3-4-test branch October 21, 2026 13:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants