Skip to content

Commit 88068cf

Browse files
Ken TakagiwaKen Takagiwa
Ken Takagiwa
authored and
Ken Takagiwa
committed
modify dstream.py to fix indent error
1 parent 1367be5 commit 88068cf

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

python/pyspark/streaming/dstream.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -172,7 +172,7 @@ def _mergeCombiners(iterator):
172172
return shuffled.mapPartitions(_mergeCombiners)
173173

174174

175-
def partitionBy(self, numPartitions, partitionFunc=None):
175+
def partitionBy(self, numPartitions, partitionFunc=None):
176176
"""
177177
Return a copy of the DStream partitioned using the specified partitioner.
178178

streaming/src/main/scala/org/apache/spark/streaming/api/python/PythonDStream.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -91,7 +91,7 @@ class PythonDStream[T: ClassTag](
9191
tempFileStream.close()
9292

9393
// This value has to be passed from python
94-
val pythonExec = new ProcessBuilder().environment().get("PYSPARK_PYTHON")
94+
//val pythonExec = new ProcessBuilder().environment().get("PYSPARK_PYTHON")
9595
val sparkHome = new ProcessBuilder().environment().get("SPARK_HOME")
9696
//val pb = new ProcessBuilder(Seq(pythonExec, sparkHome + "/python/pyspark/streaming/pyprint.py", tempFile.getAbsolutePath())) // why this fails to compile???
9797
//absolute path to the python script is needed to change because we do not use pysparkstreaming

0 commit comments

Comments
 (0)