Commits

Branch selector

 master

User selector

tgravescs

Datepicker

All time

Commit History

Commits on Mar 10, 2022

• [SPARK-38379][K8S] Fix Kubernetes Client mode when mounting persistent volume with storage class

  Show description for f286416
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  f286416

  Copy full SHA for f286416

Commits on Nov 5, 2021

• [SPARK-37208][YARN] Support mapping Spark gpu/fpga resource types to custom YARN resource types

  Show description for 8e6f636
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  8e6f636

  Copy full SHA for 8e6f636

Commits on Dec 2, 2020

• [SPARK-33544][SQL] Optimize size of CreateArray/CreateMap to be the size of its children

  Show description for f71f345
  

  tgravescs

  and

  HyukjinKwon

  committed
  f71f345

  Copy full SHA for f71f345

Commits on Nov 13, 2020

• [SPARK-33288][SPARK-32661][K8S] Stage level scheduling support for Kubernetes

  Show description for acfd846
  tgravescs

  committed
  acfd846

  Copy full SHA for acfd846

Commits on Oct 30, 2020

• [SPARK-32037][CORE] Rename blacklisting feature

  Show description for 72ad9dc
  tgravescs

  committed
  72ad9dc

  Copy full SHA for 72ad9dc

Commits on Sep 9, 2020

• [SPARK-32823][WEB UI] Fix the master ui resources reporting

  Show description for 514bf56
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  514bf56

  Copy full SHA for 514bf56

• [SPARK-32824][CORE] Improve the error message when the user forgets the .amount in a resource config

  Show description for e8634d8
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  e8634d8

  Copy full SHA for e8634d8

Commits on Aug 25, 2020

• [SPARK-32287][TESTS][FOLLOWUP] Add debugging for flaky ExecutorAllocationManagerSuite

  Show description for 2feab4e
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  2feab4e

  Copy full SHA for 2feab4e

Commits on Jul 29, 2020

• [SPARK-30322][DOCS] Add stage level scheduling docs

  Show description for e926d41
  tgravescs

  committed
  e926d41

  Copy full SHA for e926d41

Commits on Jul 24, 2020

• [SPARK-32287][TESTS] Flaky Test: ExecutorAllocationManagerSuite.add executors default profile

  Show description for e6ef27b
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  e6ef27b

  Copy full SHA for e6ef27b

Commits on Jun 2, 2020

• [SPARK-29150][CORE] Update RDD API for Stage level scheduling to be public

  Show description for ff4a97d
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  ff4a97d

  Copy full SHA for ff4a97d

Commits on May 21, 2020

• [SPARK-29303][WEB UI] Add UI support for stage level scheduling

  Show description for b64688e
  tgravescs

  committed
  b64688e

  Copy full SHA for b64688e

Commits on Apr 23, 2020

• [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests

  Show description for 95aec09
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  95aec09

  Copy full SHA for 95aec09

Commits on Apr 7, 2020

• [SPARK-31378][CORE] stage level scheduling dynamic allocation bug with initial num executors

  Show description for 30f1866
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  30f1866

  Copy full SHA for 30f1866

Commits on Apr 2, 2020

• [SPARK-29153][CORE] Add ability to merge resource profiles within a stage with Stage Level Scheduling

  Show description for 55dea9b
  tgravescs

  committed
  55dea9b

  Copy full SHA for 55dea9b

Commits on Mar 26, 2020

• [SPARK-29154][CORE] Update Spark scheduler for stage level scheduling

  Show description for 474b1bb
  tgravescs

  committed
  474b1bb

  Copy full SHA for 474b1bb

Commits on Mar 9, 2020

• [SPARK-31055][DOCS] Update config docs for shuffle local host reads to have dep on external shuffle service

  Show description for e807118
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  e807118

  Copy full SHA for e807118

Commits on Feb 28, 2020

• [SPARK-29149][YARN] Update YARN cluster manager For Stage Level Scheduling

  Show description for 0e2ca11
  tgravescs

  committed
  0e2ca11

  Copy full SHA for 0e2ca11

• [SPARK-30987][CORE] Increase the timeout on local-cluster waitUntilExecutorsUp calls

  Show description for 6c0c41f
  

  tgravescs

  authored and

  jiangxb1987

  committed
  6c0c41f

  Copy full SHA for 6c0c41f

Commits on Feb 25, 2020

• [SPARK-30942] Fix the warning for requiring cores to be limiting resources

  Show description for c46c067
  tgravescs

  committed
  c46c067

  Copy full SHA for c46c067

Commits on Feb 12, 2020

• [SPARK-29148][CORE] Add stage level scheduling dynamic allocation and scheduler backend changes

  Show description for 496f6ac
  tgravescs

  committed
  496f6ac

  Copy full SHA for 496f6ac

Commits on Feb 1, 2020

• [SPARK-30689][CORE][YARN] Add resource discovery plugin api to support YARN versions with resource scheduling

  Show description for 878094f
  tgravescs

  committed
  878094f

  Copy full SHA for 878094f

Commits on Jan 31, 2020

• [SPARK-30638][CORE][FOLLOWUP] Fix a spacing issue and use UTF-8 instead of ASCII

  Show description for ff0f636
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  ff0f636

  Copy full SHA for ff0f636

• [SPARK-30638][CORE] Add resources allocated to PluginContext

  Show description for 3d2b8d8
  tgravescs

  committed
  3d2b8d8

  Copy full SHA for 3d2b8d8

Commits on Jan 29, 2020

• [SPARK-30529][CORE] Improve error messages when Executor dies before registering with driver

  Show description for e5c7f89
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  e5c7f89

  Copy full SHA for e5c7f89

Commits on Jan 17, 2020

• [SPARK-29306][CORE] Stage Level Sched: Executors need to track what ResourceProfile they are created with

  Show description for 6dbfa2b
  tgravescs

  committed
  6dbfa2b

  Copy full SHA for 6dbfa2b

Commits on Jan 10, 2020

• [SPARK-30448][CORE] accelerator aware scheduling enforce cores as limiting resource

  Show description for d6532c7
  tgravescs

  committed
  d6532c7

  Copy full SHA for d6532c7

Commits on Jan 8, 2020

• [SPARK-30445][CORE] Accelerator aware scheduling handle setting configs to 0

  Show description for 0a72dba
  

  tgravescs

  authored and

  dongjoon-hyun

  committed
  0a72dba

  Copy full SHA for 0a72dba

Commits on Nov 25, 2019

• [SPARK-29415][CORE] Stage Level Sched: Add base ResourceProfile and Request classes

  Show description for 2d5de25
  tgravescs

  committed
  2d5de25

  Copy full SHA for 2d5de25

Commits on Nov 5, 2019

• [SPARK-29763] Fix Stage UI Page not showing all accumulators in Task Table

  Show description for 075cd55
  

  tgravescs

  authored and

  Marcelo Vanzin

  committed
  075cd55

  Copy full SHA for 075cd55

Commits on Sep 11, 2019

• [SPARK-27492][DOC][YARN][K8S][CORE] Resource scheduling high level user docs

  Show description for b425f8e
  tgravescs

  committed
  b425f8e

  Copy full SHA for b425f8e

Commits on Sep 4, 2019

• [SPARK-27489][WEBUI] UI updates to show executor resource information

  Show description for 4c8f114
  

  tgravescs

  authored and

  gengliangwang

  committed
  4c8f114

  Copy full SHA for 4c8f114

Commits on Jul 16, 2019

• [SPARK-27959][YARN] Change YARN resource configs to use .amount

  Show description for 43d68cd
  

  tgravescs

  authored and

  Marcelo Vanzin

  committed
  43d68cd

  Copy full SHA for 43d68cd

Commits on Jul 11, 2019

• [SPARK-28234][CORE][PYTHON] Add python and JavaSparkContext support to get resources

  Show description for f84cca2
  

  tgravescs

  authored and

  HyukjinKwon

  committed
  f84cca2

  Copy full SHA for f84cca2

Commits on Jun 6, 2019

• [SPARK-27760][CORE] Spark resources - change user resource config from .count to .amount

  Show description for d30284b
  tgravescs

  committed
  d30284b

  Copy full SHA for d30284b

Pagination

Previous

Next