test_multiprocessing_forkserver: test_shared_memory_basics() failed with FileExistsError: [Errno 17] File exists: '/test01_tsmb'

[vstinner]

BPO	45310
Nosy	@vstinner, @ambv, @serhiy-storchaka, @pablogsal, @miss-islington
PRs	bpo-45310: Fix parrallel shared memory tests #28661 [3.10] bpo-45310: Fix parrallel shared memory tests (GH-28661) #28669 [3.9] bpo-45310: Fix parrallel shared memory tests (GH-28661) #28670 [3.8] bpo-45310: Fix parrallel shared memory tests (GH-28661) #28979

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2021-10-01.10:09:29.385>
created_at = <Date 2021-09-28.12:22:18.967>
labels = ['tests', '3.9', '3.10', '3.11']
title = "test_multiprocessing_forkserver: test_shared_memory_basics() failed with FileExistsError: [Errno 17] File exists: '/test01_tsmb'"
updated_at = <Date 2021-10-19.19:15:10.142>
user = 'https://github.com/vstinner'

bugs.python.org fields:

activity = <Date 2021-10-19.19:15:10.142>
actor = 'lukasz.langa'
assignee = 'none'
closed = True
closed_date = <Date 2021-10-01.10:09:29.385>
closer = 'serhiy.storchaka'
components = ['Tests']
creation = <Date 2021-09-28.12:22:18.967>
creator = 'vstinner'
dependencies = []
files = []
hgrepos = []
issue_num = 45310
keywords = ['patch']
message_count = 6.0
messages = ['402770', '402998', '403004', '403005', '403171', '404339']
nosy_count = 5.0
nosy_names = ['vstinner', 'lukasz.langa', 'serhiy.storchaka', 'pablogsal', 'miss-islington']
pr_nums = ['28661', '28669', '28670', '28979']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = None
url = 'https://bugs.python.org/issue45310'
versions = ['Python 3.9', 'Python 3.10', 'Python 3.11']

[vstinner]

AMD64 Fedora Stable LTO + PGO 3.10 (build 357):
https://buildbot.python.org/all/#/builders/651/builds/357

First test_multiprocessing_forkserver failed, then test_multiprocessing_spawn, then test_multiprocessing_fork.

I confirm that these tests fail if the /test01_tsmb shared memory exists.

The test is supposed to unlink the shared memory once the test completes:

    def test_shared_memory_basics(self):
        sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
        self.addCleanup(sms.unlink)

Maybe the whole process was killed while the test was running.

I removed it manually:

sudo ./python -c "import _posixshmem; _posixshmem.shm_unlink('/test01_tsmb')"

Logs:

Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto-pgo/build/Lib/multiprocessing/resource_tracker.py", line 209, in main
    cache[rtype].remove(name)
KeyError: '/psm_49a93592'
(...)

======================================================================
ERROR: test_shared_memory_basics (test.test_multiprocessing_forkserver.WithProcessesTestSharedMemory)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto-pgo/build/Lib/test/_test_multiprocessing.py", line 3777, in test_shared_memory_basics
    sms = shared_memory.SharedMemory('test01_tsmb', create=True, size=512)
  File "/home/buildbot/buildarea/3.10.cstratak-fedora-stable-x86_64.lto-pgo/build/Lib/multiprocessing/shared_memory.py", line 103, in __init__
    self._fd = _posixshmem.shm_open(
FileExistsError: [Errno 17] File exists: '/test01_tsmb'

[serhiy-storchaka]

New changeset eb4495e by Serhiy Storchaka in branch 'main':
bpo-45310: Fix parrallel shared memory tests (GH-28661)
eb4495e

[serhiy-storchaka]

New changeset 4d5d161 by Serhiy Storchaka in branch '3.9':
[3.9] bpo-45310: Fix parrallel shared memory tests (GH-28661) (GH-28670)
4d5d161

[miss-islington]

New changeset 4e6681d by Miss Islington (bot) in branch '3.10':
bpo-45310: Fix parrallel shared memory tests (GH-28661)
4e6681d

[pablogsal]

New changeset bc4c705 by Pablo Galindo (Miss Islington (bot)) in branch '3.10':
bpo-45310: Fix parrallel shared memory tests (GH-28661)
bc4c705