Commits

Branch selector

 master

User selector

harshmotw-db

Datepicker

All time

Commit History

Commits on Jan 15, 2025

• [SPARK-50815][PYTHON][SQL] Fix bug where passing null Variants in createDataFrame causes it to fail and add Variant support in createDataFrame in Spark Connect

  Show description for 39bb2d8
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  39bb2d8

  Copy full SHA for 39bb2d8

Commits on Dec 13, 2024

• [SPARK-45891][SQL][TESTS] Make VariantSuite test agnostic of the stableDerivedColumnAlias config

  Show description for c1a9fc1
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  c1a9fc1

  Copy full SHA for c1a9fc1

Commits on Dec 9, 2024

• [SPARK-50063][SQL][CONNECT] Add support for Variant in the Spark Connect Scala client

  Show description for 32431cf
  

  harshmotw-db

  authored and

  hvanhovell

  committed
  32431cf

  Copy full SHA for 32431cf

• [SPARK-50503][SQL] Prohibit partitioning by Variant data

  Show description for 88c3813
  

  harshmotw-db

  authored and

  hvanhovell

  committed
  88c3813

  Copy full SHA for 88c3813

Commits on Dec 2, 2024

• [SPARK-50373] Prohibit Variant from set operations

  Show description for 171e2ce
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  171e2ce

  Copy full SHA for 171e2ce

Commits on Nov 13, 2024

• [SPARK-50238][PYTHON] Add Variant Support in PySpark UDFs/UDTFs/UDAFs

  Show description for 4002a53
  

  harshmotw-db

  authored and

  HyukjinKwon

  committed
  4002a53

  Copy full SHA for 4002a53

Commits on Oct 23, 2024

• [SPARK-49902][SQL] Catch underlying runtime errors in RegExpReplace

  Show description for 35d2ef9
  

  harshmotw-db

  and

  MaxGekk

  committed
  35d2ef9

  Copy full SHA for 35d2ef9

• [SPARK-49985][SQL] Remove support for interval types in Variant

  Show description for 2957069
  

  harshmotw-db

  authored and

  HyukjinKwon

  committed
  2957069

  Copy full SHA for 2957069

Commits on Oct 15, 2024

• [SPARK-49451][SQL][FOLLOW-UP] Improve duplicate key exception test

  Show description for c3176a7
  

  harshmotw-db

  authored and

  MaxGekk

  committed
  c3176a7

  Copy full SHA for c3176a7

Commits on Sep 21, 2024

• [SPARK-49451][FOLLOW-UP] Add support for duplicate keys in from_json(_, 'variant')

  Show description for f235bab
  

  harshmotw-db

  authored and

  HyukjinKwon

  committed
  f235bab

  Copy full SHA for f235bab

Commits on Sep 10, 2024

• [SPARK-49443][SQL][PYTHON] Implement to_variant_object expression and make schema_of_variant expressions print OBJECT for for Variant Objects

  Show description for 3709c2e
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  3709c2e

  Copy full SHA for 3709c2e

Commits on Aug 26, 2024

• [SPARK-49311][SQL] Make it possible for large 'interval second' values to be cast to decimal

  Show description for e10a789
  

  harshmotw-db

  authored and

  MaxGekk

  committed
  e10a789

  Copy full SHA for e10a789

Commits on Aug 17, 2024

• [SPARK-45891][FOLLOW-UP][VARIANT] Address post-merge comments

  Show description for 469ebcf
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  469ebcf

  Copy full SHA for 469ebcf

Commits on Jul 27, 2024

• [SPARK-45891][SQL][PYTHON][VARIANT] Add support for interval types in the Variant Spec

  Show description for 388ca1e
  

  harshmotw-db

  authored and

  HyukjinKwon

  committed
  388ca1e

  Copy full SHA for 388ca1e

Commits on May 10, 2024

• [SPARK-48224][SQL] Disallow map keys from being of variant type

  Show description for b371e7d
  

  harshmotw-db

  authored and

  dongjoon-hyun

  committed
  b371e7d

  Copy full SHA for b371e7d

Commits on May 2, 2024

• [SPARK-45891][SQL][FOLLOW-UP] Added length check to the is_variant_null expression

  Show description for 0fc7c4a
  

  harshmotw-db

  authored and

  dongjoon-hyun

  committed
  0fc7c4a

  Copy full SHA for 0fc7c4a

Commits on Apr 26, 2024

• [SPARK-47922][SQL] Implement the try_parse_json expression

  Show description for 033ca3e
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  033ca3e

  Copy full SHA for 033ca3e

Commits on Apr 24, 2024

• [SPARK-47903][PYTHON][FOLLOW-UP] Removed changes relating to try_parse_json

  Show description for fd695be
  

  harshmotw-db

  authored and

  HyukjinKwon

  committed
  fd695be

  Copy full SHA for fd695be

Commits on Apr 22, 2024

• [SPARK-47903][PYTHON] Add support for remaining scalar types in the PySpark Variant library

  Show description for 9e7ee76
  

  harshmotw-db

  authored and

  HyukjinKwon

  committed
  9e7ee76

  Copy full SHA for 9e7ee76

Commits on Apr 18, 2024

• [SPARK-47846][SQL] Add support for Variant type in from_json expression

  Show description for 61a7901
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  61a7901

  Copy full SHA for 61a7901

Commits on Apr 17, 2024

• [SPARK-47822][SQL] Prohibit Hash Expressions from hashing the Variant Data Type

  Show description for 4e754f7
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  4e754f7

  Copy full SHA for 4e754f7

• [SPARK-47821][SQL] Implement is_variant_null expression

  Show description for 76882d0
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  76882d0

  Copy full SHA for 76882d0

Commits on Jul 18, 2023

• [SPARK-44154][SQL] Added more unit tests to BitmapExpressionUtilsSuite and made minor improvements to Bitmap Aggregate Expressions

  Show description for df550cf
  

  harshmotw-db

  authored and

  cloud-fan

  committed
  df550cf

  Copy full SHA for df550cf