Commits

Branch selector

 master

User selector

BryanCutler

Datepicker

All time

Commit History

Commits on Dec 1, 2020

• [SPARK-33613][PYTHON][TESTS] Replace deprecated APIs in pyspark tests

  Show description for aeb3649
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  aeb3649

  Copy full SHA for aeb3649

Commits on Nov 18, 2020

• [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark with Arrow

  Show description for 8e2a0bd
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  8e2a0bd

  Copy full SHA for 8e2a0bd

Commits on Oct 21, 2020

• [SPARK-33189][PYTHON][TESTS] Add env var to tests for legacy nested timestamps in pyarrow

  Show description for 47a6568
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  47a6568

  Copy full SHA for 47a6568

Commits on Oct 6, 2020

• [SPARK-33073][PYTHON] Improve error handling on Pandas to Arrow conversion failures

  Show description for 0812d6c
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  0812d6c

  Copy full SHA for 0812d6c

Commits on Sep 10, 2020

• [SPARK-32312][SQL][PYTHON][TEST-JAVA11] Upgrade Apache Arrow to version 1.0.1

  Show description for e0538bd
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  e0538bd

  Copy full SHA for e0538bd

Commits on Jul 6, 2020

• [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

  Show description for 1d18096
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  1d18096

  Copy full SHA for 1d18096

Commits on Jun 24, 2020

• [SPARK-32080][SPARK-31998][SQL] Simplify ArrowColumnVector ListArray accessor

  Show description for df04107
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  df04107

  Copy full SHA for df04107

Commits on Jun 11, 2020

• [SPARK-31964][PYTHON] Use Pandas is_categorical on Arrow category type conversion

  Show description for b7ef529
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  b7ef529

  Copy full SHA for b7ef529

Commits on May 28, 2020

• [SPARK-25351][PYTHON][TEST][FOLLOWUP] Fix test assertions to be consistent

  Show description for 8bbb666
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  8bbb666

  Copy full SHA for 8bbb666

Commits on Feb 17, 2020

• [SPARK-30834][DOCS][PYTHON] Add note for recommended pandas and pyarrow versions

  Show description for be3cb71
  

  BryanCutler

  and

  HyukjinKwon

  committed
  be3cb71

  Copy full SHA for be3cb71

Commits on Feb 11, 2020

• [SPARK-30777][PYTHON][TESTS] Fix test failures for Pandas >= 1.0.0

  Show description for 07a9885
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  07a9885

  Copy full SHA for 07a9885

Commits on Jan 26, 2020

• [SPARK-30640][PYTHON][SQL] Prevent unnecessary copies of data during Arrow to Pandas conversion

  Show description for 43d9c7e
  BryanCutler

  committed
  43d9c7e

  Copy full SHA for 43d9c7e

Commits on Jan 10, 2020

• [SPARK-29748][PYTHON][SQL] Remove Row field sorting in PySpark for version 3.6+

  Show description for f372d1c
  BryanCutler

  committed
  f372d1c

  Copy full SHA for f372d1c

Commits on Nov 15, 2019

• [SPARK-29376][SQL][PYTHON] Upgrade Apache Arrow to version 0.15.1

  Show description for 65a189c
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  65a189c

  Copy full SHA for 65a189c

Commits on Oct 11, 2019

• [SPARK-29402][PYTHON][TESTS] Added tests for grouped map pandas_udf with window

  Show description for beb8d2f
  BryanCutler

  committed
  beb8d2f

  Copy full SHA for beb8d2f

• [SPARK-29367][DOC] Add compatibility note for Arrow 0.15.0 to SQL guide

  Show description for 6390f02
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  6390f02

  Copy full SHA for 6390f02

Commits on Jun 26, 2019

• [SPARK-27992][PYTHON] Allow Python to join with connection thread to propagate errors

  Show description for c277afb
  BryanCutler

  committed
  c277afb

  Copy full SHA for c277afb

Commits on Jun 22, 2019

• [SPARK-28128][PYTHON][SQL] Pandas Grouped UDFs skip empty partitions

  Show description for 5ad1053
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  5ad1053

  Copy full SHA for 5ad1053

Commits on Jun 18, 2019

• [SPARK-28041][PYTHON] Increase minimum supported Pandas to 0.23.2

  Show description for 90f8039
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  90f8039

  Copy full SHA for 90f8039

Commits on May 7, 2019

• [SPARK-23961][SPARK-27548][PYTHON] Fix error when toLocalIterator goes out of scope and properly raise errors from worker

  Show description for 5e79ae3
  BryanCutler

  committed
  5e79ae3

  Copy full SHA for 5e79ae3

Commits on Apr 22, 2019

• [SPARK-27276][PYTHON][SQL] Increase minimum version of pyarrow to 0.12.1 and remove prior workarounds

  Show description for d36cce1
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  d36cce1

  Copy full SHA for d36cce1

Commits on Apr 9, 2019

• [SPARK-27387][PYTHON][TESTS] Replace sqlutils.assertPandasEqual with Pandas assert_frame_equals

  Show description for f62f44f
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  f62f44f

  Copy full SHA for f62f44f

Commits on Mar 21, 2019

• [SPARK-27163][PYTHON] Cleanup and consolidate Pandas UDF functionality

  Show description for be08b41
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  be08b41

  Copy full SHA for be08b41

Commits on Mar 7, 2019

• [SPARK-23836][PYTHON] Add support for StructType return in Scalar Pandas UDF

  Show description for ddc2052
  BryanCutler

  committed
  ddc2052

  Copy full SHA for ddc2052

Commits on Jan 29, 2019

• [SPARK-26566][PYTHON][SQL] Upgrade Apache Arrow to version 0.12.0

  Show description for 16990f9
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  16990f9

  Copy full SHA for 16990f9

Commits on Dec 6, 2018

• [SPARK-25274][PYTHON][SQL] In toPandas with Arrow send un-ordered record batches to improve performance

  Show description for ecaa495
  BryanCutler

  committed
  ecaa495

  Copy full SHA for ecaa495

Commits on Nov 18, 2018

• [SPARK-26033][PYTHON][TESTS] Break large ml/tests.py file into smaller files

  Show description for 034ae30
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  034ae30

  Copy full SHA for 034ae30

Commits on Nov 16, 2018

• [SPARK-26034][PYTHON][TESTS] Break large mllib/tests.py file into smaller files

  Show description for a2fc48c
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  a2fc48c

  Copy full SHA for a2fc48c

Commits on Sep 20, 2018

• [SPARK-25471][PYTHON][TEST] Fix pyspark-sql test error when using Python 3.6 and Pandas 0.23

  Show description for 90e3955
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  90e3955

  Copy full SHA for 90e3955

Commits on Aug 29, 2018

• [SPARK-23030][SQL][PYTHON] Use Arrow stream format for creating from and collecting Pandas DataFrames

  Show description for 82c18c2
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  82c18c2

  Copy full SHA for 82c18c2

Commits on Aug 18, 2018

• [SPARK-23555][PYTHON] Add BinaryType support for Arrow in Python

  Show description for 10f2b6f
  BryanCutler

  committed
  10f2b6f

  Copy full SHA for 10f2b6f

Commits on Aug 15, 2018

• [SPARK-23874][SQL][PYTHON] Upgrade Apache Arrow to 0.10.0

  Show description for ed075e1
  BryanCutler

  committed
  ed075e1

  Copy full SHA for ed075e1

Commits on Jun 26, 2018

• [SPARK-24324][PYTHON][FOLLOWUP] Grouped Map positional conf should have deprecation note

  Show description for d48803b
  BryanCutler

  committed
  d48803b

  Copy full SHA for d48803b

Commits on Jun 24, 2018

• [SPARK-24324][PYTHON] Pandas Grouped Map UDF should assign result columns by name

  Show description for a5849ad
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  a5849ad

  Copy full SHA for a5849ad

Commits on Jun 1, 2018

• [SPARK-24444][DOCS][PYTHON] Improve Pandas UDF docs to explain column assignment

  Show description for b2d0226
  

  BryanCutler

  authored and

  HyukjinKwon

  committed
  b2d0226

  Copy full SHA for b2d0226

Pagination

Previous

Next