Skip to content

Commit b0f2015

Browse files
committed
added comment in dstream._test_output
1 parent bebb3f3 commit b0f2015

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

python/pyspark/streaming/dstream.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -397,6 +397,10 @@ def _test_output(self, result):
397397
Store data in a DStream to result to verify the result in test case
398398
"""
399399
def get_output(rdd, time):
400+
"""
401+
Closure to get element in RDD in the DStream.
402+
This closure is called by py4j callback server.
403+
"""
400404
collected = rdd.collect()
401405
result.append(collected)
402406

0 commit comments

Comments
 (0)