All pull requests

Pull requests

• [SPARK-60951][PYTHON] Support configurable aggregation level for the Python UDF sampling profiler

  ai-review-requested
  #60150·gaogaotiantian opened Nov 5, 2026Contributor·

  ·

• [SPARK-60950][CORE] Reply with a failure when MapOutputTrackerMaster fails to handle a map output status request

  #60149·sadikovi opened Nov 5, 2026Contributor·

  ·

• [SPARK-60945][SQL][PROTOBUF] Copy stateful options before evaluating from_protobuf/to_protobuf

  #60148·charlhhhh opened Nov 5, 2026·

  ·
  1

• [SPARK-60944][SQL] Skip DSv2 filters on fully pushed attributes

  #60147·szehon-ho opened Nov 5, 2026Member·

  ·
  7

• [SPARK-33552][UI] Declare document language in Spark UI pages

  #60146·adityavaish opened Nov 5, 2026·

  ·

• [SPARK-60943][SQL] Fix wrong results when a cast from DECIMAL(19, 0) to BIGINT overflows

  #60145·dongjoon-hyun opened Nov 5, 2026Member·

  ·
  16

• [SPARK-60941][SQL] Move JoinSelection's choice for non-equi joins into JoinSelectionHelper

  #60144·pmenon opened Nov 5, 2026Contributor·

  ·
  4

• [SPARK-60940][SQL] Vectorized Parquet/ORC readers return wrong values for map column DEFAULTs

  #60143·hemanthboyina opened Nov 5, 2026Contributor·

  ·

• [SPARK-60914][YARN] Remove recommissioned nodes from YarnAllocator's decommissioningNodesCache

  #60142·rdtr opened Nov 5, 2026·

  ·

• [MINOR][DOC] Clarify fractional seconds in second and extract functions

  #60141·adityavaish opened Nov 5, 2026·

  ·

• [SPARK-60925][CORE] Register REST API resources explicitly instead of…

  #60135·anoopamS opened Nov 5, 2026Contributor·

  ·
  9

• [SPARK-60910][SQL] Fail on overflow in datediff instead of wrapping around

  #60134·SEPURI-SAI-KRISHNA opened Nov 5, 2026Contributor·

  ·

• [SPARK-60932][INFRA][TEST] Fix npm vulnerabilities in dev and ui-test

  #60133·LuciferYang opened Nov 5, 2026Contributor·

  ·

• [SPARK-60916][SQL] Fix Parquet IN filter pushdown with NULL on a BOOLEAN column

  #60132·Raviston6296 opened Nov 5, 2026·

  ·

• [SPARK-60931][SS] Use local filesystem for batch TransformWithState state store

  #60131·Kimahriman opened Nov 5, 2026Contributor·

  ·
  2

• [SPARK-60929][SQL] Fail on overflow in next_day and last_day instead of wrapping around

  #60130·stevomitric opened Nov 5, 2026Contributor·

  ·
  1

• [SPARK-60926][SS] Push the filters of streaming queries down to the scans of Data Source V2 streaming sources

  ai-review-requested
  #60129·HyukjinKwon opened Nov 5, 2026Member·

  ·
  20

• [SPARK-60928][BUILD] Upgrade Guava to 33.8.0-jre

  #60128·LuciferYang opened Nov 5, 2026Contributor·

  ·

• [SPARK-][SQL] Single-pass analyzer improvements

  #60127·mihailoale-db opened Nov 5, 2026Contributor·

  ·

• [SPARK-60924][INFRA][4.X] Use GraphQL to count commits for post-merge CI sampling

  ai-review-requested
  #60126·zhengruifeng opened Nov 5, 2026Contributor·

  ·

• [SPARK-60924][INFRA] Use GraphQL to count commits for post-merge CI sampling

  ai-review-requested
  #60124·zhengruifeng opened Nov 5, 2026Contributor·

  ·
  2

• [SPARK-60923][INFRA] Upgrade the scheduled no-GIL Python build to Python 3.15

  #60122·zhengruifeng opened Nov 5, 2026Contributor·

  ·

• [SPARK-59589][4.3][SQL] Hand Expand's varying output columns to the consumer as globals

  #60121·LuciferYang opened Nov 5, 2026Contributor·

  ·

• [SPARK-60882][SQL] Accept more expressions that can not fail in ExprUtils.canEvaluateUnconditionally

  ai-review-requested
  #60119·sarutak opened Nov 5, 2026Member·

  ·
  8

• [SPARK-60904][SQL] Preserve the output partitioning of shuffled FULL OUTER joins

  ai-review-requested
  #60118·ulysses-you opened Nov 5, 2026Contributor·

  ·
  21