All pull requests

Pull requests

• [SPARK-61481][CONNECT][PYTHON] Let a second stop() release the session after an interrupted one, and let a signal end the waits of the streaming listener bus, in the Python client as PySpark does

  #539·HyukjinKwon opened Nov 12, 2026Member·

  ·

• [SPARK-61483][CONNECT][PYTHON] Send the bytes of binary literal subclasses, corr and cov without a limit, and check the Arrow schema of createDataFrame depth first, in the Python client as PySpark does

  #538·HyukjinKwon opened Nov 12, 2026Member·

  ·

• [SPARK-61490][CONNECT][PYTHON] Release the instance dict of the Python client's PyO3 classes when they are freed, which PyO3 0.28 keeps

  #537·HyukjinKwon opened Nov 12, 2026Member·

  ·

• [SPARK-61440][CONNECT] Make the retries of the calls of the Spark Connect Rust client in one place, and do not panic on a stream deadline too far to be a time

  #536·HyukjinKwon opened Nov 12, 2026Member·

  ·

• [SPARK-61470][CONNECT][PYTHON] Let Ctrl-C end every call of the Python client that waits for the server, and raise the error of a failed interrupt, as PySpark does

  #535·HyukjinKwon opened Nov 12, 2026Member·

  ·

• [SPARK-61473][CONNECT][PYTHON] Raise PySpark's errors for the operands that Column operators and methods do not take, in the Python client

  #534·HyukjinKwon opened Nov 11, 2026Member·

  ·

• [WIP][CONNECT] Let a Rust UDF read the session's Python worker environment through WASI

  #529·RamonZhou opened Nov 11, 2026·

  ·

• [SPARK-61442][CONNECT][FOLLOWUP] Read trailing whitespace in JSON type strings and backquoted collation names in DDL, as PySpark and Spark do

  #527·HyukjinKwon opened Nov 11, 2026Member·

  ·

• [SPARK-61443][CONNECT][PYTHON][FOLLOWUP] Keep a listener that a signal interrupts removable, and stop removeListener at the first match, as PySpark does

  #524·HyukjinKwon opened Nov 11, 2026Member·

  ·

• [SPARK-61441][CONNECT][FOLLOWUP] Keep a listener re-added from a stream error subscribed, and free the listener bus after a panicking progress handler

  #523·HyukjinKwon opened Nov 11, 2026Member·

  ·

• [SPARK-61453][CONNECT] Support native DecisionTreeRegressor training and prediction

  #515·zhengruifeng opened Nov 11, 2026Contributor·

  ·
  1

• [SPARK-61426][CONNECT][PYTHON] Check the observed metrics of only the Observations of the executed plan, keep the metrics of earlier actions, and raise for nested unconvertible metrics, in the Python client as PySpark does

  #503·HyukjinKwon opened Nov 11, 2026Member·

  ·

• [WIP][SPARK-61384][CONNECT] Add embedded Rust Spark Connect JVM server

  #474·dbtsai opened Nov 10, 2026Member·

  ·

• [SPARK-59432][CONNECT][INFRA] Build free-threaded (cp3xxt) wheels

  #101·james-willis opened Sep 11, 2026Contributor·

  ·
  15