Skip to content

Commit 158f876

Browse files
committed
[SPARK-46127][PYTHON][TESTS] Disable pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault with Python 3.12
### What changes were proposed in this pull request? This PR disables `pyspark.tests.test_worker.WorkerSegfaultNonDaemonTest.test_python_segfault` with Python 3.12 for now. ### Why are the changes needed? This test is flaky, and stops the tests run till the end, e.g., see https://github.com/apache/spark/actions/runs/7006848931/job/19059701743 How `faulthandler` is used is correct, as documented in the standard Python documentation. So I do believe this is a bug from Python 3.12. I will track separately in Python side. ### Does this PR introduce _any_ user-facing change? No, test-only. ### How was this patch tested? Manually: ```bash python/run-tests --python-executable=python3 --testnames 'pyspark.tests.test_worker WorkerSegfaultNonDaemonTest.test_python_segfault' ``` ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#44044 from HyukjinKwon/SPARK-46127. Authored-by: Hyukjin Kwon <gurwls223@apache.org> Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
1 parent 2800b58 commit 158f876

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

python/pyspark/tests/test_worker.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -230,6 +230,7 @@ def conf(cls):
230230
_conf.set("spark.python.worker.faulthandler.enabled", "true")
231231
return _conf
232232

233+
@unittest.skipIf(sys.version_info < (3, 12), "SPARK-46130: Flaky with Python 3.12")
233234
def test_python_segfault(self):
234235
try:
235236

0 commit comments

Comments
 (0)