Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 28, 2023

• [SPARK-32407][SPARK-35375][INFRA][DOCS] Delete comments on `Sphinx` and `Jinja2`

  Show description for bfb0882
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  bfb0882

  Copy full SHA for bfb0882

• [SPARK-46131][PYTHON][INFRA] Install torchvision for Python 3.12 build

  Show description for 984e797
  HyukjinKwon

  committed
  984e797

  Copy full SHA for 984e797

• [SPARK-46127][PYTHON][TESTS] Disable pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault with Python 3.12

  Show description for 158f876
  HyukjinKwon

  committed
  158f876

  Copy full SHA for 158f876

• [SPARK-46116][DOCS][PYTHON] Adding "Stack Overflow" and "Mailing Lists" link into PySpark doc homepage

  Show description for 2800b58
  

  itholic

  authored and

  yaooqinn

  committed
  2800b58

  Copy full SHA for 2800b58

• [SPARK-46006][YARN][FOLLOWUP] YarnAllocator set target executor number to 0 to cancel pending allocate request when driver stop

  Show description for dbc8756
  

  AngersZhuuuu

  authored and

  yaooqinn

  committed
  dbc8756

  Copy full SHA for dbc8756

• [SPARK-46126][PYTHON][TESTS] Fix the doctest in pyspark.pandas.frame.DataFrame.to_dict (Python 3.12)

  Show description for 4f59e1b
  HyukjinKwon

  committed
  4f59e1b

  Copy full SHA for 4f59e1b

• [SPARK-46111][DOCS][PYTHON] Add copyright to the PySpark official documentation

  Show description for ec7d07c
  

  itholic

  authored and

  HyukjinKwon

  committed
  ec7d07c

  Copy full SHA for ec7d07c

Commits on Nov 27, 2023

• [SPARK-46121][PYTHON][DOCS] Refine docstring of `concat/array_position/element_at/try_element_at`

  Show description for 753b2f2
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  753b2f2

  Copy full SHA for 753b2f2

• [SPARK-46115][SQL] Restrict charsets in `encode()`

  Show description for 2430e87
  

  MaxGekk

  authored and

  HyukjinKwon

  committed
  2430e87

  Copy full SHA for 2430e87

• [SPARK-46103][FOLLOWUP] Keep Sphinx version consistency in spark-rm

  Show description for 11ac856
  

  panbingkun

  authored and

  HyukjinKwon

  committed
  11ac856

  Copy full SHA for 11ac856

• [SPARK-45957][CONNECT] Avoid generating execution plan for non-executable commands

  Show description for 8697166
  

  jdesjean

  authored and

  HyukjinKwon

  committed
  8697166

  Copy full SHA for 8697166

• [SPARK-46089][BUILD] Upgrade commons-lang3 to 3.14.0

  Show description for e6edb10
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  e6edb10

  Copy full SHA for e6edb10

• [SPARK-46118][SQL][SS][CONNECT] Use `SparkSession.sessionState.conf` instead of `SQLContext.conf` and mark `SQLContext.conf` as deprecated

  Show description for 92e832a
  LuciferYang

  committed
  92e832a

  Copy full SHA for 92e832a

• [SPARK-46110][PYTHON] Use error classes in catalog, conf, connect, observation, pandas modules

  Show description for 7d1db89
  HyukjinKwon

  committed
  7d1db89

  Copy full SHA for 7d1db89

• [SPARK-46120][CONNECT][PYTHON] Remove helper function `DataFrame.withPlan`

  Show description for 8ad0230
  

  zhengruifeng

  authored and

  HyukjinKwon

  committed
  8ad0230

  Copy full SHA for 8ad0230

• [SPARK-46123][DOCS][PYTHON] Using brighter color for document title for better visibility

  Show description for cd47a4c
  

  itholic

  authored and

  HyukjinKwon

  committed
  cd47a4c

  Copy full SHA for cd47a4c

• [SPARK-46113][BUILD][DOCS] Update `pydata_sphinx_theme` version requirement to `>=0.13`

  Show description for f9ea668
  

  itholic

  authored and

  HyukjinKwon

  committed
  f9ea668

  Copy full SHA for f9ea668

• [MINOR][PYTHON] Remove _inferSchema in SQLContext

  Show description for 8d646fe
  HyukjinKwon

  committed
  8d646fe

  Copy full SHA for 8d646fe

• [MINOR][PYTHON][DOCS] Remove since decorator usages in pyspark.sql

  Show description for 685f536
  HyukjinKwon

  committed
  685f536

  Copy full SHA for 685f536

• [MINOR][PYTHON] Remove obsolete TODOs for ignores at SQLContext and HiveContext

  Show description for 08f23f7
  HyukjinKwon

  committed
  08f23f7

  Copy full SHA for 08f23f7

• [SPARK-46114][PYTHON] Add PySparkIndexError for error framework

  Show description for 0193d0f
  HyukjinKwon

  committed
  0193d0f

  Copy full SHA for 0193d0f

• [SPARK-45699][BUILD][CORE][SQL][SS][CONNECT][MLLIB][ML][DSTREAM][GRAPHX][K8S][UI] Fixing all compilation warnings related to widening conversions

  Show description for e1a2255
  

  hannahkamundson

  authored and

  LuciferYang

  committed
  e1a2255

  Copy full SHA for e1a2255

• [SPARK-46099][PS][DOCS] Refactor "Supported pandas API" generation script

  Show description for ef27b9b
  

  itholic

  authored and

  HyukjinKwon

  committed
  ef27b9b

  Copy full SHA for ef27b9b

Commits on Nov 26, 2023

• [SPARK-46084][PS][FOLLOWUP] More refactoring by using `create_map`

  Show description for d971dc4
  

  itholic

  authored and

  HyukjinKwon

  committed
  d971dc4

  Copy full SHA for d971dc4

• [SPARK-46103][PYTHON][INFRA][BUILD][DOCS] Enhancing PySpark documentation

  Show description for 400db88
  

  itholic

  authored and

  HyukjinKwon

  committed
  400db88

  Copy full SHA for 400db88

• [SPARK-46074][CONNECT][SCALA] Insufficient details in error message on UDF failure

  Show description for d5fad63
  

  nija-at

  authored and

  HyukjinKwon

  committed
  d5fad63

  Copy full SHA for d5fad63

• [SPARK-45974][SQL] Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering

  Show description for ade861d
  

  wForget

  authored and

  cloud-fan

  committed
  ade861d

  Copy full SHA for ade861d

• [SPARK-45826][SQL] Add a SQL config for stack traces in DataFrame query context

  Show description for d30c9a9
  MaxGekk

  committed
  d30c9a9

  Copy full SHA for d30c9a9

Commits on Nov 25, 2023

• [SPARK-46100][CORE][PYTHON] Reduce stack depth by replace (string|array).size with (string|array).length

  Show description for 7b58fff
  

  beliefer

  authored and

  srowen

  committed
  7b58fff

  Copy full SHA for 7b58fff

• [SPARK-46085][CONNECT] Dataset.groupingSets in Scala Spark Connect client

  Show description for 5211f6b
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  5211f6b

  Copy full SHA for 5211f6b

• [SPARK-46095][DOCS] Document `REST API` for Spark Standalone Cluster

  Show description for a694a8a
  dongjoon-hyun

  committed
  a694a8a

  Copy full SHA for a694a8a

• [SPARK-46066][SQL] Use the Separators API instead of the String API to construct the `DefaultPrettyPrinter`

  Show description for 50f189b
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  50f189b

  Copy full SHA for 50f189b

• [SPARK-45922][CONNECT][CLIENT] Minor retries refactoring (follow-up to multiple policies)

  Show description for 2f6a38c
  

  cdkrot

  authored and

  HyukjinKwon

  committed
  2f6a38c

  Copy full SHA for 2f6a38c

Commits on Nov 24, 2023

• [SPARK-46016][DOCS][PS] Fix pandas API support list properly

  Show description for 132bb63
  

  itholic

  authored and

  HyukjinKwon

  committed
  132bb63

  Copy full SHA for 132bb63

• [SPARK-46087][PYTHON] Sync PySpark dependencies in docs and dev requirements

  Show description for 441e15e
  

  itholic

  authored and

  dongjoon-hyun

  committed
  441e15e

  Copy full SHA for 441e15e

Pagination

Previous

Next