Commits

Branch selector

 master

User selector

JoshRosen

Datepicker

All time

Commit History

Commits on Aug 29, 2022

• [SPARK-40235][CORE] Use interruptible lock instead of synchronized in Executor.updateDependencies()

  Show description for 295dd57
  JoshRosen

  committed
  295dd57

  Copy full SHA for 295dd57

Commits on Jul 27, 2022

• [SPARK-39864][SQL] Lazily register ExecutionListenerBus

  Show description for 869fc21
  

  JoshRosen

  authored and

  HyukjinKwon

  committed
  869fc21

  Copy full SHA for 869fc21

Commits on Jul 23, 2022

• [SPARK-39847][SS] Fix race condition in RocksDBLoader.loadLibrary() if caller thread is interrupted

  Show description for 9cee1bb
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  9cee1bb

  Copy full SHA for 9cee1bb

Commits on Jul 10, 2022

• [SPARK-39702][CORE] Reduce memory overhead of TransportCipher$EncryptedMessage by using a shared byteRawChannel

  Show description for 06ee7c2
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  06ee7c2

  Copy full SHA for 06ee7c2

Commits on Jul 3, 2022

• [SPARK-39489][CORE] Improve event logging JsonProtocol performance by using Jackson instead of Json4s

  Show description for 6f0c4f3
  JoshRosen

  committed
  6f0c4f3

  Copy full SHA for 6f0c4f3

Commits on Jun 30, 2022

• [SPARK-39636][CORE][UI] Fix multiple bugs in JsonProtocol, impacting off heap StorageLevels and Task/Executor ResourceRequests

  Show description for a39fc87
  JoshRosen

  committed
  a39fc87

  Copy full SHA for a39fc87

Commits on Jun 9, 2022

• [SPARK-39422][SQL] Improve error message for 'SHOW CREATE TABLE' with unsupported serdes

  Show description for 8765eea
  JoshRosen

  committed
  8765eea

  Copy full SHA for 8765eea

Commits on Jun 4, 2022

• [SPARK-39259][SQL][FOLLOWUP] Fix source and binary incompatibilities in transformDownWithSubqueries

  Show description for eda6c4b
  

  JoshRosen

  authored and

  MaxGekk

  committed
  eda6c4b

  Copy full SHA for eda6c4b

Commits on Jun 2, 2022

• [SPARK-39361] Don't use Log4J2's extended throwable conversion pattern in default logging configurations

  Show description for fd45c36
  JoshRosen

  committed
  fd45c36

  Copy full SHA for fd45c36

Commits on May 24, 2022

• [SPARK-39266][CORE] Cleanup unused spark.rpc.numRetries and spark.rpc.retry.wait configs

  Show description for e7b8be3
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  e7b8be3

  Copy full SHA for e7b8be3

Commits on Jan 4, 2022

• [SPARK-37784][SQL] Correctly handle UDTs in CodeGenerator.addBufferedState()

  Show description for eeef48f
  JoshRosen

  committed
  eeef48f

  Copy full SHA for eeef48f

Commits on Nov 29, 2021

• [SPARK-37447][SQL] Cache LogicalPlan.isStreaming() result in a lazy val

  Show description for 5d09828
  

  JoshRosen

  authored and

  cloud-fan

  committed
  5d09828

  Copy full SHA for 5d09828

Commits on Nov 19, 2021

• [SPARK-37379][SQL] Add tree pattern pruning to CTESubstitution rule

  Show description for 3b4eb1f
  JoshRosen

  committed
  3b4eb1f

  Copy full SHA for 3b4eb1f

Commits on Oct 18, 2021

• [SPARK-36151][INFRA] MiMa updates after 3.2.0 release: bump previousSparkVersion and re-enable tests for Scala 2.13 artifacts

  Show description for 47111af
  

  JoshRosen

  authored and

  HyukjinKwon

  committed
  47111af

  Copy full SHA for 47111af

Commits on Oct 14, 2021

• [SPARK-23626][CORE] Eagerly compute RDD.partitions on entire DAG when submitting job to DAGScheduler

  Show description for c4e975e
  JoshRosen

  committed
  c4e975e

  Copy full SHA for c4e975e

Commits on Sep 16, 2021

• [SPARK-36774][CORE][TESTS] Move SparkSubmitTestUtils to core module and use it in SparkSubmitSuite

  Show description for 3ae6e67
  JoshRosen

  committed
  3ae6e67

  Copy full SHA for 3ae6e67

Commits on Mar 2, 2020

• [SPARK-31003][TESTS] Fix incorrect uses of assume() in tests

  Show description for f0010c8
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  f0010c8

  Copy full SHA for f0010c8

• [SPARK-29419][SQL] Fix Encoder thread-safety bug in createDataset(Seq)

  Show description for f4499f6
  

  JoshRosen

  authored and

  HyukjinKwon

  committed
  f4499f6

  Copy full SHA for f4499f6

Commits on Feb 25, 2020

• [SPARK-30944][BUILD] Update URL for Google Cloud Storage mirror of Maven Central

  Show description for f152d2a
  

  JoshRosen

  authored and

  HyukjinKwon

  committed
  f152d2a

  Copy full SHA for f152d2a

Commits on Jan 20, 2020

• [SPARK-30413][SQL] Avoid WrappedArray roundtrip in GenericArrayData constructor, plus related optimization in ParquetMapConverter

  Show description for d50f8df
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  d50f8df

  Copy full SHA for d50f8df

Commits on Jan 7, 2020

• [SPARK-30414][SQL] ParquetRowConverter optimizations: arrays, maps, plus misc. constant factors

  Show description for 7a1a5db
  

  2 peopleauthored and

  HyukjinKwon

  committed
  7a1a5db

  Copy full SHA for 7a1a5db

• [SPARK-30338][SQL] Avoid unnecessary InternalRow copies in ParquetRowConverter

  Show description for 93d3ab8
  

  2 peopleauthored and

  cloud-fan

  committed
  93d3ab8

  Copy full SHA for 93d3ab8

Commits on Oct 2, 2019

• [SPARK-29310][CORE][TESTS] TestMemoryManager should implement getExecutionMemoryUsageForTask()

  Show description for c6938ea
  

  2 peopleauthored and

  cloud-fan

  committed
  c6938ea

  Copy full SHA for c6938ea

Commits on Jul 18, 2019

• [SPARK-28430][UI] Fix stage table rendering when some tasks' metrics are missing

  Show description for 3776fbd
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  3776fbd

  Copy full SHA for 3776fbd

Commits on Jun 26, 2019

• [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

  Show description for d83f84a
  

  2 peopleauthored and

  HyukjinKwon

  committed
  d83f84a

  Copy full SHA for d83f84a

Commits on Jun 20, 2019

• [SPARK-28112][TEST] Fix Kryo exception perf. bottleneck in tests due to absence of ML/MLlib classes

  Show description for ec032ce
  

  JoshRosen

  and

  gatorsmile

  committed
  ec032ce

  Copy full SHA for ec032ce

Commits on Jun 19, 2019

• [SPARK-28102][CORE] Avoid performance problems when lz4-java JNI libraries fail to initialize

  Show description for 6b27ad5
  

  JoshRosen

  and

  joshrosen-stripe

  committed
  6b27ad5

  Copy full SHA for 6b27ad5

• [SPARK-27839][SQL] Change UTF8String.replace() to operate on UTF8 bytes

  Show description for fc65e0f
  JoshRosen

  committed
  fc65e0f

  Copy full SHA for fc65e0f

Commits on Jun 10, 2019

• [SPARK-27846][CORE] Eagerly compute Configuration.properties in sc.hadoopConfiguration

  Show description for 95a9212
  

  JoshRosen

  authored and

  dongjoon-hyun

  committed
  95a9212

  Copy full SHA for 95a9212

Commits on May 29, 2019

• [SPARK-27829][SQL] In Dataset.joinWith() inner joins, don't nest data before shuffling

  Show description for 19aaf0f
  

  2 peopleauthored and

  cloud-fan

  committed
  19aaf0f

  Copy full SHA for 19aaf0f

Commits on May 21, 2019

• [SPARK-27786][SQL] Fix Sha1, Md5, and Base64 codegen when commons-codec is shaded

  Show description for 604aa1b
  

  JoshRosen

  authored and

  cloud-fan

  committed
  604aa1b

  Copy full SHA for 604aa1b

Commits on May 7, 2018

• [SPARK-24160] ShuffleBlockFetcherIterator should fail if it receives zero-size blocks

  Show description for d2aa859
  

  JoshRosen

  authored and

  cloud-fan

  committed
  d2aa859

  Copy full SHA for d2aa859

Commits on Jan 10, 2018

• [SPARK-22997] Add additional defenses against use of freed MemoryBlocks

  Show description for f340b6b
  JoshRosen

  committed
  f340b6b

  Copy full SHA for f340b6b

• [SPARK-22982] Remove unsafe asynchronous close() call from FileDownloadChannel

  Show description for edf0a48
  

  JoshRosen

  authored and

  cloud-fan

  committed
  edf0a48

  Copy full SHA for edf0a48

Commits on Jan 9, 2018

• [SPARK-22984] Fix incorrect bitmap copying and offset adjustment in GenerateUnsafeRowJoiner

  Show description for f20131d
  

  JoshRosen

  authored and

  cloud-fan

  committed
  f20131d

  Copy full SHA for f20131d

Pagination

Previous

Next