Commits

Branch selector

 master

User selector

allisonwang-db

Datepicker

All time

Commit History

Commits on Jan 3, 2024

• [SPARK-46565][PYTHON] Refine error classes and error messages for Python data sources

  Show description for bdb6172
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  bdb6172

  Copy full SHA for bdb6172

Commits on Jan 2, 2024

• [SPARK-46540][PYTHON] Respect column names when Python data source read function outputs named Row objects

  Show description for 48a09c4
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  48a09c4

  Copy full SHA for 48a09c4

Commits on Dec 29, 2023

• [SPARK-45914][PYTHON] Support commit and abort API for Python data source write

  Show description for f99b86a
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  f99b86a

  Copy full SHA for f99b86a

Commits on Dec 27, 2023

• [SPARK-46520][PYTHON] Support overwrite mode for Python data source write

  Show description for 638078f
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  638078f

  Copy full SHA for 638078f

Commits on Dec 22, 2023

• [SPARK-45525][SQL][PYTHON] Support for Python data source write using DSv2

  Show description for 4fcd5bf
  

  allisonwang-db

  authored and

  cloud-fan

  committed
  4fcd5bf

  Copy full SHA for 4fcd5bf

Commits on Dec 20, 2023

• [SPARK-46452][SQL] Add a new API in DataWriter to write an iterator of records

  Show description for c9cfaac
  

  allisonwang-db

  authored and

  cloud-fan

  committed
  c9cfaac

  Copy full SHA for c9cfaac

• [SPARK-46272][SQL] Support CTAS using DSv2 sources

  Show description for cc9d991
  

  allisonwang-db

  authored and

  cloud-fan

  committed
  cc9d991

  Copy full SHA for cc9d991

Commits on Dec 14, 2023

• [SPARK-46043][SQL][FOLLOWUP] Remove the catalog and identifier check in DataSourceV2Relation

  Show description for c045a42
  

  allisonwang-db

  authored and

  cloud-fan

  committed
  c045a42

  Copy full SHA for c045a42

Commits on Dec 12, 2023

• [SPARK-46253][PYTHON] Plan Python data source read using MapInArrow

  Show description for 01d61a5
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  01d61a5

  Copy full SHA for 01d61a5

Commits on Dec 11, 2023

• [SPARK-46273][SQL] Support INSERT INTO/OVERWRITE using DSv2 sources

  Show description for 7db8564
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  7db8564

  Copy full SHA for 7db8564

Commits on Dec 7, 2023

• [SPARK-46290][PYTHON] Change saveMode to a boolean flag for DataSourceWriter

  Show description for 9da1e4c
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  9da1e4c

  Copy full SHA for 9da1e4c

Commits on Dec 5, 2023

• [SPARK-46043][SQL] Support create table using DSv2 sources

  Show description for 5fec76d
  

  allisonwang-db

  authored and

  cloud-fan

  committed
  5fec76d

  Copy full SHA for 5fec76d

Commits on Dec 4, 2023

• [SPARK-45940][FOLLOWUP][TESTS] Only test Python data source when Python and PySpark environments are available

  Show description for d5f2539
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  d5f2539

  Copy full SHA for d5f2539

Commits on Nov 30, 2023

• [SPARK-45940][PYTHON] Add InputPartition to DataSourceReader interface

  Show description for 2fad7b7
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  2fad7b7

  Copy full SHA for 2fad7b7

Commits on Nov 23, 2023

• [SPARK-45600][PYTHON] Make Python data source registration session level

  Show description for c8ad616
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  c8ad616

  Copy full SHA for c8ad616

Commits on Nov 22, 2023

• [SPARK-46013][PYTHON][SQL][DOCS] Improve data source load and save functions docs page

  Show description for f0cdb09
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  f0cdb09

  Copy full SHA for f0cdb09

Commits on Nov 20, 2023

• [SPARK-45927][PYTHON] Update path handling for Python data source

  Show description for 25ee62e
  

  allisonwang-db

  authored and

  dongjoon-hyun

  committed
  25ee62e

  Copy full SHA for 25ee62e

Commits on Nov 16, 2023

• [SPARK-45930][SQL] Support non-deterministic UDFs in MapInPandas/MapInArrow

  Show description for 1a1d303
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  1a1d303

  Copy full SHA for 1a1d303

• [SPARK-45931][PYTHON][DOCS] Refine docstring of mapInPandas

  Show description for e795dc1
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  e795dc1

  Copy full SHA for e795dc1

Commits on Nov 13, 2023

• [SPARK-45783][PYTHON][CONNECT] Improve error messages when Spark Connect mode is enabled but remote URL is not set

  Show description for d2a1a31
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  d2a1a31

  Copy full SHA for d2a1a31

Commits on Nov 8, 2023

• [SPARK-45639][SQL][PYTHON] Support loading Python data sources in DataFrameReader

  Show description for 9d93b71
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  9d93b71

  Copy full SHA for 9d93b71

Commits on Nov 6, 2023

• [SPARK-45773][PYTHON][DOCS] Refine docstring of SparkSession.builder.config

  Show description for 82ffd25
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  82ffd25

  Copy full SHA for 82ffd25

Commits on Nov 1, 2023

• [SPARK-45654][PYTHON] Add Python data source write API

  Show description for 14d347c
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  14d347c

  Copy full SHA for 14d347c

Commits on Oct 31, 2023

• [SPARK-45713][PYTHON] Support registering Python data sources

  Show description for 6cb0cd5
  

  allisonwang-db

  authored and

  cloud-fan

  committed
  6cb0cd5

  Copy full SHA for 6cb0cd5

Commits on Oct 24, 2023

• [SPARK-45524][PYTHON][SQL] Initial support for Python data source read API

  Show description for 7ef96ee
  

  allisonwang-db

  authored and

  ueshin

  committed
  7ef96ee

  Copy full SHA for 7ef96ee

Commits on Oct 20, 2023

• [SPARK-45584][SQL] Fix subquery execution failure with TakeOrderedAndProjectExec

  Show description for 8fd915f
  

  allisonwang-db

  authored and

  cloud-fan

  committed
  8fd915f

  Copy full SHA for 8fd915f

Commits on Oct 19, 2023

• [SPARK-45220][PYTHON][DOCS] Refine docstring of DataFrame.join

  Show description for db16236
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  db16236

  Copy full SHA for db16236

Commits on Oct 13, 2023

• [SPARK-45505][PYTHON] Refactor analyzeInPython to make it reusable

  Show description for 280f6b3
  

  allisonwang-db

  authored and

  ueshin

  committed
  280f6b3

  Copy full SHA for 280f6b3

Commits on Oct 12, 2023

• [SPARK-45442][PYTHON][DOCS] Refine docstring of DataFrame.show

  Show description for 5a00631
  

  allisonwang-db

  authored and

  zhengruifeng

  committed
  5a00631

  Copy full SHA for 5a00631

Commits on Oct 8, 2023

• [SPARK-45401][PYTHON] Add a new method cleanup in the UDTF interface

  Show description for d6b1fd4
  

  allisonwang-db

  authored and

  dongjoon-hyun

  committed
  d6b1fd4

  Copy full SHA for d6b1fd4

Commits on Sep 21, 2023

• [SPARK-45219][PYTHON][DOCS] Refine docstring of withColumn(s)Renamed

  Show description for cf04bd9
  

  allisonwang-db

  and

  HyukjinKwon

  committed
  cf04bd9

  Copy full SHA for cf04bd9

Commits on Sep 20, 2023

• [SPARK-45107][PYTHON][DOCS] Refine docstring of explode

  Show description for c1dc9ae
  

  allisonwang-db

  authored and

  zhengruifeng

  committed
  c1dc9ae

  Copy full SHA for c1dc9ae

• [SPARK-45218][PYTHON][DOCS] Refine docstring of Column.isin

  Show description for 76acd12
  

  allisonwang-db

  authored and

  zhengruifeng

  committed
  76acd12

  Copy full SHA for 76acd12

Commits on Sep 14, 2023

• [SPARK-45119][PYTHON][DOCS] Refine docstring of inline

  Show description for cb298e8
  

  allisonwang-db

  authored and

  zhengruifeng

  committed
  cb298e8

  Copy full SHA for cb298e8

Commits on Sep 8, 2023

• [SPARK-44508][PYTHON][DOCS] Add user guide for Python user-defined table functions

  Show description for aaf413c
  

  allisonwang-db

  authored and

  HyukjinKwon

  committed
  aaf413c

  Copy full SHA for aaf413c

Pagination

Previous

Next