Commits

Branch selector

 master

User selector

lianhuiwang

Datepicker

All time

Commit History

Commits on Jun 14, 2017

• [SPARK-20986][SQL] Reset table's statistics after PruneFileSourcePartitions rule.

  

  lianhuiwang

  authored and

  cloud-fan

  committedJun 14, 2017
  8b5b2e2

Commits on Sep 2, 2016

• [SPARK-16302][SQL] Set the right number of partitions for reading data from a local collection.

  

  lianhuiwang

  authored and

  JoshRosen

  committedSep 2, 2016
  06e3398

Commits on Jul 12, 2016

• [SPARK-15752][SQL] Optimize metadata only query that has an aggregate whose children are deterministic project or filter operators.

  

  lianhuiwang

  authored and

  hvanhovell

  committedJul 12, 2016
  5ad68ba

Commits on Jun 4, 2016

• [SPARK-15756][SQL] Support command 'create table stored as orcfile/parquetfile/avrofile'

  

  lianhuiwang

  authored and

  rxin

  committedJun 4, 2016
  2ca563c

Commits on Jun 1, 2016

• [SPARK-15664][MLLIB] Replace FileSystem.get(conf) with path.getFileSystem(conf) when removing CheckpointFile in MLlib

  

  lianhuiwang

  authored and

  srowen

  committedJun 1, 2016
  6563d72

Commits on May 31, 2016

• [SPARK-15649][SQL] Avoid to serialize MetastoreRelation in HiveTableScanExec

  

  lianhuiwang

  authored and

  rxin

  committedMay 31, 2016
  2bfc4f1

Commits on May 20, 2016

• [SPARK-15335][SQL] Implement TRUNCATE TABLE Command

  

  lianhuiwang

  authored and

  rxin

  committedMay 20, 2016
  09a0051

Commits on May 11, 2016

• [SPARK-15246][SPARK-4452][CORE] Fix code style and improve volatile for

  

  lianhuiwang

  authored and

  rxin

  committedMay 11, 2016
  9f0a642

Commits on Apr 25, 2016

• [SPARK-14731][shuffle]Revert SPARK-12130 to make 2.0 shuffle service compatible with 1.x

  

  lianhuiwang

  authored and

  Marcelo Vanzin

  committedApr 25, 2016
  6bfe42a

Commits on Apr 21, 2016

• [SPARK-4452] [CORE] Shuffle data structures can starve others on the same thread for memory

  

  lianhuiwang

  authored and

  davies

  committedApr 21, 2016
  4f36917

Commits on Apr 20, 2016

• [SPARK-14705][YARN] support Multiple FileSystem for YARN STAGING DIR

  

  lianhuiwang

  authored and

  Marcelo Vanzin

  committedApr 20, 2016
  4514aeb

Commits on Feb 23, 2016

• [SPARK-7729][UI] Executor which has been killed should also be displayed on Executor Tab

  

  lianhuiwang

  authored and

  Andrew Or

  committedFeb 23, 2016
  9f42633

Commits on Dec 16, 2015

• [SPARK-12130] Replace shuffleManagerClass with shortShuffleMgrNames in ExternalShuffleBlockResolver

  

  lianhuiwang

  authored and

  Andrew Or

  committedDec 16, 2015
  369127f

Commits on Nov 10, 2015

• [SPARK-11252][NETWORK] ShuffleClient should release connection after fetching blocks had been completed for external shuffle

  

  lianhuiwang

  authored and

  Marcelo Vanzin

  committedNov 10, 2015
  6e5fc37

Commits on Oct 13, 2015

• [SPARK-11026] [YARN] spark.yarn.user.classpath.first does work for 'spark-submit --jars hdfs://user/foo.jar'

  

  lianhuiwang

  authored and

  Tom Graves

  committedOct 13, 2015
  626aab7

Commits on Jul 17, 2015

• [SPARK-8646] PySpark does not run on YARN if master not provided in command line

  

  lianhuiwang

  authored and

  Andrew Or

  committedJul 17, 2015
  49351c7

Commits on Jun 19, 2015

• [SPARK-8430] ExternalShuffleBlockResolver of shuffle service should support UnsafeShuffleManager

  

  lianhuiwang

  authored and

  Andrew Or

  committedJun 19, 2015
  9baf093

Commits on Jun 18, 2015

• [SPARK-8381][SQL]reuse typeConvert when convert Seq[Row] to catalyst type

  

  lianhuiwang

  authored and

  JoshRosen

  committedJun 18, 2015
  9db73ec

Commits on May 8, 2015

• [SPARK-6869] [PYSPARK] Add pyspark archives path to PYTHONPATH

  

  lianhuiwang

  authored and

  tgravescs

  committedMay 8, 2015
  ebff732

Commits on Mar 2, 2015

• [SPARK-6103][Graphx]remove unused class to import in EdgeRDDImpl

  

  lianhuiwang

  authored and

  srowen

  committedMar 2, 2015
  49c7a8f

Commits on Feb 12, 2015

• [SPARK-5759][Yarn]ExecutorRunnable should catch YarnException while NMClient start contain...

  

  lianhuiwang

  authored and

  Andrew Or

  committedFeb 12, 2015
  947b8bd

Commits on Feb 6, 2015

• [SPARK-4994][network]Cleanup removed executors' ShuffleInfo in yarn shuffle service

  

  lianhuiwang

  authored and

  Andrew Or

  committedFeb 6, 2015
  61073f8

• [SPARK-5593][Core]Replace BlockManagerListener with ExecutorListener in ExecutorAllocationListener

  

  lianhuiwang

  authored and

  Andrew Or

  committedFeb 6, 2015
  6072fcc

• [SPARK-5653][YARN] In ApplicationMaster rename isDriver to isClusterMode

  

  lianhuiwang

  authored and

  Andrew Or

  committedFeb 6, 2015
  cc6e531

• [SPARK-5470][Core]use defaultClassLoader to load classes in KryoSerializer

  

  lianhuiwang

  authored and

  srowen

  committedFeb 6, 2015
  ed3aac7

Commits on Feb 2, 2015

• [SPARK-5173]support python application running on yarn cluster mode

  

  lianhuiwang

  authored and

  Andrew Or

  committedFeb 2, 2015
  f5e6375

Commits on Jan 28, 2015

• [SPARK-4955]With executor dynamic scaling enabled,executor shoude be added or killed in yarn-cluster mode.

  

  lianhuiwang

  authored and

  Andrew Or

  committedJan 28, 2015
  81f8f34

Commits on Jan 12, 2015

• [SPARK-5102][Core]subclass of MapStatus needs to be registered with Kryo

  

  lianhuiwang

  authored and

  pwendell

  committedJan 12, 2015
  ef9224e

Commits on Nov 6, 2014

• [SPARK-4249][GraphX]fix a problem of EdgePartitionBuilder in Graphx

  

  lianhuiwang

  authored and

  ankurdave

  committedNov 6, 2014
  d15c6e9

Commits on Jul 20, 2014

• [SPARK-2524] missing document about spark.deploy.retainedDrivers

  

  lianhuiwang

  authored and

  pwendell

  committedJul 20, 2014
  4da01e3

Commits on Jul 15, 2014

• discarded exceeded completedDrivers

  

  lianhuiwang

  authored and

  rxin

  committedJul 15, 2014
  7446f5f

Commits on May 27, 2014

• bugfix worker DriverStateChanged state should match DriverState.FAILED

  

  lianhuiwang

  authored and

  aarondav

  committedMay 27, 2014
  95e4c9c