Skip to content

Commit cd46230

Browse files
author
Andrew Or
committed
Revert a small change that affected streaming
DStream#transform isn't cleaning closures correctly. It is passing an RDD to ClosureCleaner#clean. We should fix this separately outside of this patch.
1 parent 0bbe77f commit cd46230

File tree

1 file changed

+0
-3
lines changed

1 file changed

+0
-3
lines changed

core/src/main/scala/org/apache/spark/util/ClosureCleaner.scala

-3
Original file line numberDiff line numberDiff line change
@@ -92,9 +92,6 @@ private[spark] object ClosureCleaner extends Logging {
9292
* Return a list of classes that represent closures enclosed in the given closure object.
9393
*/
9494
private def getInnerClosureClasses(obj: AnyRef): List[Class[_]] = {
95-
if (!isClosure(obj.getClass)) {
96-
throw new IllegalArgumentException(s"Expected a closure object; got ${obj.getClass.getName}")
97-
}
9895
val seen = Set[Class[_]](obj.getClass)
9996
var stack = List[Class[_]](obj.getClass)
10097
while (!stack.isEmpty) {

0 commit comments

Comments
 (0)