All pull requests

Pull requests

• [SPARK-60441][CORE] Let a task release UnsafeSorterSpillReader's record buffer before it ends

  #59685·qingfureal opened Oct 21, 2026Contributor·

  ·

• [SPARK-60439][SQL] Support DataSource V2 pushdown for aggregates with FILTER clauses

  #59684·hemanthboyina opened Oct 21, 2026Contributor·

  ·

• [SPARK-60437][DOCS] Fix stale API references in the Data Source V2 page and add a connector walkthrough

  #59683·lisancao opened Oct 21, 2026·

  ·

• [SPARK-60436][SQL] Fix ORC filter pushdown on timestamp literals with sub-millisecond digits

  #59682·dongjoon-hyun opened Oct 21, 2026Member·

  ·

• [SPARK-60433][SQL] Support non-constant expressions in VALUES lists

  #59681·dtenedor opened Oct 21, 2026Contributor·

  ·
  4

• [SPARK-60430][CORE] Fix FileSystemRecoveryModeFactory to handle none as a codec

  #59680·dongjoon-hyun opened Oct 21, 2026Member·

  ·

• [SPARK-60432][CORE] Validate spark.io.compression.zstd.bufferSize

  #59679·dongjoon-hyun opened Oct 21, 2026Member·

  ·

• [SPARK-60431][SQL] Split a wide projection's outputs into methods under whole-stage codegen

  #59678·qingfureal opened Oct 21, 2026Contributor·

  ·

• [SPARK-60428][SQL] Avoid zeroing Arrow vectors to their full capacity in ArrowWriter.reset()

  #59677·qingfureal opened Oct 21, 2026Contributor·

  ·

• [SPARK-59718][SQL][4.x] Add opt-in in-process Python UDF execution via Arrow C Data Interface

  #59676·viirya opened Oct 21, 2026Member·

  ·
  1

• [SPARK-60425][SQL] Fix InternalRow.copyValue to clone Array[Byte] values

  #59675·wangyum opened Oct 21, 2026Member·

  ·

• [SPARK-60424][SQL] Fix Hive timestamp type parsing with spark.sql.timestampType=TIMESTAMP_NTZ

  #59674·dongjoon-hyun opened Oct 21, 2026Member·

  ·
  3

• Andres.amar/kotlin spark package build

  #59672·andresamar-batch-infra opened Oct 21, 2026·

  ·

• [SPARK-60420][SQL] Add JDBC options to control Oracle TimestampNTZ mapping and wall-clock conversion separately

  #59671·aleksandar-trajkovic-db opened Oct 21, 2026Contributor·

  ·

• [SPARK-60419][CORE] Fix file descriptor leak in FileSystemPersistenceEngine.deserializeFromFile when compression is enabled

  #59670·sarutak opened Oct 21, 2026Member·

  ·
  4

• [SPARK-59151][SQL] Implement the CanonicalizeVariant Catalyst expression

  #59669·SavicStefan opened Oct 21, 2026Contributor·

  ·

• [SPARK-60418][SQL] Skip subexpression elimination for a conditional IN list element

  #59668·SEPURI-SAI-KRISHNA opened Oct 21, 2026Contributor·

  ·

• [SPARK-60417][ML][PYTHON] Remove type: ignore[no-untyped-def] in pyspark.ml.torch.distributor

  #59667·soaring0616 opened Oct 21, 2026Contributor·

  ·

• [MINOR][INFRA] Suggest Assisted-by instead of Generated-by in PR template

  #59666·nchammas opened Oct 21, 2026Contributor·

  ·
  5

• [SPARK-60416][SQL][SS] Allow Structured Streaming Coverage in SQL Tests

  #59665·siying opened Oct 21, 2026Contributor·

  ·
  5

• [SPARK-60333][SQL] Fix make_timestamp second overflow

  #59664·Huang-404-Q opened Oct 21, 2026·

  ·

• [SPARK-60222][CORE] Keep task completion listeners on the completing thread when another thread invokes listeners

  #59663·viirya opened Oct 21, 2026Member·

  ·
  16

• [SQL] Expose subquery planning context to DataSource V2 scan builders

  #59662·yyanyy opened Oct 21, 2026Contributor·

  ·
  1

• [SPARK-60413][SQL] Warn when evolving a DSv2 table that accepts any schema

  #59660·szehon-ho opened Oct 20, 2026Member·

  ·
  1

• [SPARK-60098][SQL] Fix memory leaks in ParquetColumnVector

  #59657·frroliveira opened Oct 20, 2026·

  ·
  1