Commits

Branch selector

 master

User selector

ericm-db

Datepicker

All time

Commit History

Commits on Sep 12, 2024

• [SPARK-49594][SS] Adding check on whether columnFamilies were added or removed to write StateSchemaV3 file

  Show description for 8023504
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  8023504

  Copy full SHA for 8023504

Commits on Sep 9, 2024

• [SPARK-49006] Implement purging for OperatorStateMetadataV2 and StateSchemaV3 files

  Show description for 532aaaf
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  532aaaf

  Copy full SHA for 532aaaf

Commits on Aug 28, 2024

• [SPARK-49050] Enabling deleteIfExists operator in TWS with Virtual Column Families

  Show description for 0b0933c
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  0b0933c

  Copy full SHA for 0b0933c

Commits on Aug 20, 2024

• [SPARK-48796][SS] Load Column Family Id from RocksDBCheckpointMetadata for VCF when restarting

  Show description for e64f620
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  e64f620

  Copy full SHA for e64f620

Commits on Jul 30, 2024

• [SPARK-49031] Implement validation for the TransformWithStateExec operator using OperatorStateMetadataV2

  Show description for 40d94b6
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  40d94b6

  Copy full SHA for 40d94b6

Commits on Jul 25, 2024

• [SPARK-48849][SS] Create OperatorStateMetadataV2 for the TransformWithStateExec operator

  Show description for 4999469
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  4999469

  Copy full SHA for 4999469

Commits on Jul 11, 2024

• [SPARK-48726][SS] Create the StateSchemaV3 file format, and write this out for the TransformWithStateExec operator

  Show description for 97a0f64
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  97a0f64

  Copy full SHA for 97a0f64

Commits on Apr 23, 2024

• [SPARK-47941][SS][CONNECT] Propagate ForeachBatch worker initialization errors to users for PySpark

  Show description for 390fb74
  

  ericm-db

  authored and

  HyukjinKwon

  committed
  390fb74

  Copy full SHA for 390fb74

• [SPARK-47805][SS] Implementing TTL for MapState

  Show description for 61ac342
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  61ac342

  Copy full SHA for 61ac342

Commits on Apr 16, 2024

• [SPARK-47673][SS] Implementing TTL for ListState

  Show description for be08070
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  be08070

  Copy full SHA for be08070

Commits on Mar 4, 2024

• [SPARK-46961][SS] Using ProcessorContext to store and retrieve handle

  Show description for 6b5917b
  

  ericm-db

  authored and

  MaxGekk

  committed
  6b5917b

  Copy full SHA for 6b5917b

Commits on Feb 8, 2024

• [SPARK-46865][SS] Add Batch Support for TransformWithState Operator

  Show description for becfb94
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  becfb94

  Copy full SHA for becfb94

Commits on Feb 6, 2024

• [SPARK-46960][SS] Testing Multiple Input Streams with TransformWithState operator

  Show description for 5100b2e
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  5100b2e

  Copy full SHA for 5100b2e

Commits on Feb 2, 2024

• [SPARK-46911][SS] Adding deleteIfExists operator to StatefulProcessorHandleImpl

  Show description for 25d96f7
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  25d96f7

  Copy full SHA for 25d96f7

Commits on Feb 1, 2024

• [SPARK-46864][SS] Onboard Arbitrary StateV2 onto New Error Class Framework

  Show description for 00e63d6
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  00e63d6

  Copy full SHA for 00e63d6

Commits on Aug 1, 2023

• [SPARK-44480][SS] Use thread pool to perform maintenance activity for hdfs/rocksdb state store providers

  Show description for 9e42805
  

  ericm-db

  authored and

  HeartSaVioR

  committed
  9e42805

  Copy full SHA for 9e42805

Commits on May 20, 2023

• [SPARK-43542][SS] Define a new error class and apply for the case where streaming query fails due to concurrent run of streaming query with same checkpoint

  Show description for 37b9c53
  

  ericm-db

  authored and

  MaxGekk

  committed
  37b9c53

  Copy full SHA for 37b9c53