Skip to content

Commit c878dfd

Browse files
committed
[SPARK-54575][PYTHON][TESTS] Reenable test SparkConnectCreationTests.test_with_none_and_nan
### What changes were proposed in this pull request? There was a bug in create dataframe from ndarray containing NaN values: NaN was incorrectly converted to Null when arrow-optimization is on, it happened to be resolved in #53280 ### Why are the changes needed? for test coverage ### Does this PR introduce _any_ user-facing change? no, test-only ### How was this patch tested? ci ### Was this patch authored or co-authored using generative AI tooling? no Closes #53305 from zhengruifeng/reenable_test_with_none_and_nan. Authored-by: Ruifeng Zheng <ruifengz@apache.org> Signed-off-by: Ruifeng Zheng <ruifengz@apache.org>
1 parent 24a341e commit c878dfd

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

python/pyspark/sql/tests/connect/test_connect_creation.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -228,7 +228,6 @@ def test_with_atom_type(self):
228228
self.assertEqual(sdf.schema, cdf.schema)
229229
self.assert_eq(sdf.toPandas(), cdf.toPandas())
230230

231-
@unittest.skip("TODO(SPARK-54575): Re-enable this test")
232231
def test_with_none_and_nan(self):
233232
# SPARK-41855: make createDataFrame support None and NaN
234233
# SPARK-41814: test with eqNullSafe

0 commit comments

Comments
 (0)