Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[KYUUBI #4664] Fix empty relation when kill executors
### _Why are the changes needed?_ This pr fixes a corner case when repartition on a local relation. e.g., ``` Repartition | LocalRelation ``` it would throw exception since there is no a actually shuffle happen ``` java.util.NoSuchElementException: key not found: 3 at scala.collection.MapLike.default(MapLike.scala:235) at scala.collection.MapLike.default$(MapLike.scala:234) at scala.collection.AbstractMap.default(Map.scala:63) at scala.collection.MapLike.apply(MapLike.scala:144) at scala.collection.MapLike.apply$(MapLike.scala:143) at scala.collection.AbstractMap.apply(Map.scala:63) at org.apache.spark.sql.FinalStageResourceManager.findExecutorToKill(FinalStageResourceManager.scala:122) at org.apache.spark.sql.FinalStageResourceManager.killExecutors(FinalStageResourceManager.scala:175) ``` ### _How was this patch tested?_ - [ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible - [ ] Add screenshots for manual tests if appropriate - [ ] [Run test](https://kyuubi.readthedocs.io/en/master/develop_tools/testing.html#running-tests) locally before make a pull request Closes #4664 from ulysses-you/kill-executors-followup. Closes #4664 3811eae [ulysses-you] Fix empty relation Authored-by: ulysses-you <ulyssesyou18@gmail.com> Signed-off-by: ulyssesyou <ulyssesyou@apache.org>
- Loading branch information