Closed
Description
Describe the bug
In cuDF, explode_outer_position
will mark the position values of empty rows with 0
. Meanwhile, the position values of empty rows are marked as null
in Spark.
Steps/Code to reproduce bug
For input data like:
- [[5,null,15], 100]
- [null, 200]
- [[], 300]
cuDF returns
- [0, 5, 100]
- [1, null, 100]
- [2, 15, 100]
- [0, null, 200]
- [0, null, 300]
But Spark returns
- [0, 5, 100]
- [1, null, 100]
- [2, 15, 100]
- [null, null, 200]
- [null, null, 300]