Search results

[SPARK-52944][CORE][SQL][YARN] Fix invalid assertions in tests

CORE

SQL

STRUCTURED STREAMING

YARN

Status: Open (in progress).

apache/sparknumber 51654

#51654 In apache/spark;

· LuciferYang opened on Jul 24, 2025

[SPARK-52905][PYTHON][FOLLOW-UP] ArrowWindowPythonExec code clean up

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51648

#51648 In apache/spark;

· zhengruifeng opened on Jul 24, 2025

[WIP][SPARK-52943][PYTHON] Enable arrow_cast for all pandas UDF eval types

CORE

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51635

#51635 In apache/spark;

· benrobby opened on Jul 23, 2025

[SPARK-52923][CORE] Allow ShuffleManager to control push merge during shuffle registration

CORE

Status: Open (in progress).

apache/sparknumber 51629

#51629 In apache/spark;

· gaoyajun02 opened on Jul 23, 2025

[SPARK-52921][SQL] Specify outputPartitioning for UnionExec for partitioner aware case

CORE

SQL

Status: Open (in progress).

apache/sparknumber 51623

#51623 In apache/spark;

· viirya opened on Jul 22, 2025

[SPARK-52904][PYTHON] Enable convertToArrowArraySafely by default

CONNECT

CORE

DOCS

PANDAS API ON SPARK

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51596

#51596 In apache/spark;

· benrobby opened on Jul 21, 2025

[SPARK-52794][PYTHON] Performance improvement of arrow-optimized python UDTF with LocalDataToArrowConversion check

CORE

PYTHON

Status: Draft (not ready).

apache/sparknumber 51479

#51479 In apache/spark;

· asl3 opened on Jul 14, 2025

[SPARK-52790][CORE] Introduce new grid testing method in SparkFunSuite

CORE

SQL

Status: Open (in progress).

apache/sparknumber 51474

#51474 In apache/spark;

· urosstan-db opened on Jul 14, 2025

[SPARK-52737][CORE] Pushdown predicate and number of apps to FsHistoryProvider when listing applications

CORE

WEB UI

Status: Open (in progress).

apache/sparknumber 51428

#51428 In apache/spark;

· shardulm94 opened on Jul 9, 2025

[SPARK-46912][CORE] Using correct environment variables on workers of StandAlone cluster

CORE

Status: Open (in progress).

apache/sparknumber 51314

#51314 In apache/spark;

· MeltonSmith opened on Jun 28, 2025

[SPARK-50686][SQL] Hash to sort aggregation fallback - memory usage optimization

CORE

SQL

Status: Open (in progress).

apache/sparknumber 51290

#51290 In apache/spark;

· akupchinskiy opened on Jun 26, 2025

[SPARK-52864] [CORE] [Tests] Let LocalSparkContext clear active context in beforeAll

CORE

Status: Open (in progress).

apache/sparknumber 51284

#51284 In apache/spark;

· price-qian opened on Jun 25, 2025