Repository navigation
Release arrow-rs / parquet Patch version 59.3.2 (October 2026) #11664
Description
- Part of [EPIC] A collection of release tickets #7392
- Follow on to Release arrow-rs / parquet Patch version
59.3.1(October 2026) #11352
We will target this branch
Release Checklist:
- Verify with downstream DataFusion tests:
- Release notes and bump version: [59_maintenance] Update version to
59.3.2and add CHANGELOG #11797 - Release Candidate + Vote thread: https://lists.apache.org/thread.html/rv6s6pkzrbfd774jpxy01f1hk58r5rmd
- Release to crates.io / approval:
- Port changelog entry onto main: chore: port changelog entries to main #11916
Required items for release
- [59_maintenance] fix:
UnionFields::from_itershould validate input #11670 - [59_maintenance] fix: implement
ArrayData::validate_valuesfor union types #11678 - [59_maintenance] fix: account for offsets in runarrays when using extend for MutableArrayData #11671
- [59_maintenance] fix(arrow-schema): validate
UnionFieldswhen deserializing #11672 - [59_maintenance] Fix sliced sparse union ArrayData conversion #11679
- [59_maintenance] fix(arrow-data): check view nulls at the right index in
ArrayDataequality #11675 - [59_maintenance] fix(arrow-array): use the field's type id in dense union logical_nulls #11680
- [59_maintenance] fix(arrow-data): account for FixedSizeList parent offset in MutableArrayData #11683
- [59_maintenance] fix: account for offset when building RunArray from ArrayData #11739
- [59_maintenance] fix: use correct length in runarray validation #11740
- [59_maintenance] fix: account for arraydata offset when comparing runarrays #11673
- [59_maintenance] Parquet: list the dictionary page first in page_encoding_stats #11699
- [59_maintenance] fix(parquet): skip miniblocks wider than 64 values instead of erroring #11754
- [59_maintenance] fix(arrow-buffer): prevent use-after-free in Buffer::shrink_to_fit when MemoryReservation::resize panics #11787
- [59_maintenance] Run CI workflows on pushes to 59_maintenance, use ubuntu runners #11781
- [59_maintenance] chore: update webpki dependencies to fix cargo audit CI #11793
- [59_maintenance] Write empty validity buffers for arrays without nulls in IPC writer #11820
Metadata
Metadata
Assignees
Labels
No labels
Activity
[59_maintenance] fix(arrow-data): check view nulls at the right index…
[59_maintenance] Parquet: list the dictionary page first in page_enco…
[59_maintenance] fix(arrow-array): use the field's type id in dense u…
[59_maintenance] fix: `UnionFields::from_iter` should validate input (#…
[59_maintenance] fix(arrow-data): account for FixedSizeList parent of…
[59_maintenance] Fix sliced sparse union ArrayData conversion (#11679)
[59_maintenance] fix: implement `ArrayData::validate_values` for unio…
alamb commentedon Oct 19, 2026
Thank you to @Jefffrey for backporting many of these PRs. I merged a bunch, and resolved some merge conflicts on others.
I and will merge the remainder when their CI is done and crank out some more backports when ready
[59_maintenance] fix(arrow-schema): validate `UnionFields` when deser…
[59_maintenance] fix: account for arraydata offset when comparing run…
alamb commentedon Oct 20, 2026
Ok, I made the two remaining PRs and merged the other up. Once CI is complete, I think we can merge them and we'll have all the items on this PR ready to go
[59_maintenance] fix: use correct length in runarray validation (#11740)
[59_maintenance] fix: account for offset when building RunArray from …
antonireus commentedon Oct 20, 2026
Could #11021 be included in 59.3.2? Without it, we can't read Parquet files written by recent Databricks Photon versions on DataFusion 55. It cherry-picks cleanly onto
59_maintenance. Happy to open the backport PR.[59_maintenance] fix: account for offsets in runarrays when using ext…
Jefffrey commentedon Oct 21, 2026
[59_maintenance] fix(parquet): skip miniblocks wider than 64 values i…
alamb commentedon Oct 21, 2026
BTW I also went through the other issues we have and I found one more i would like to backport
I will prepare PRs for this
[59_maintenance] Run CI workflows on pushes to 59_maintenance, use ub…
[59_maintenance] fix(arrow-buffer): prevent use-after-free in Buffer:…
[59_maintenance] chore: update webpki dependencies to fix cargo audit…
alamb commentedon Oct 22, 2026
Ok, according to the list above, I think we have all the content we are targeting for the 59 release
I made a PR to update the version and changelog here:
59.3.2and add CHANGELOG #11797[59_maintenance] Write empty validity buffers for arrays without null…
[59_maintenance] Update version to `59.3.2` and add CHANGELOG (#11797)
Jefffrey commentedon Oct 23, 2026
voting up: https://lists.apache.org/thread.html/rv6s6pkzrbfd774jpxy01f1hk58r5rmd
Jefffrey commentedon Oct 26, 2026
published to crates.io
chore: port changelog entries to main (apache#11916)