[FreeBSD] psutil.pids() fails with `[Errno 12] Cannot allocate memory (originated from sysctl)`

[pilot513]

Summary

• OS: { FreeBSD 13.0 P2 }
• OS Core: 13.0-RELEASE-p2 FreeBSD 13.0-RELEASE-p2 Test suite failures on Linux #2 releng/13.0-n244746-b74cdf1ecea
• Architecture: { 64bit, Intel(R) Xeon(R) CPU E5630 @ 2.53GHz }
• Psutil version: { py38-psutil-5.9.0 }
• Python version: { Python 3.8.13 }
• Type: core

Description

04/04/22 (23:39:26) | ERROR: Data collection thread failed with exception: [Errno 12] Cannot allocate memory (originated from sysctl)
Traceback (most recent call last):
  File "/usr/local/bin/bpytop", line 2958, in _runner
    collector._collect()
  File "/usr/local/bin/bpytop", line 3728, in _collect
    for p in sorted(psutil.process_iter(cls.p_values + (["memory_info"] if CONFIG.proc_mem_bytes else []), err), key=lambda p: eval(sort_cmd), reverse=reverse):
  File "/usr/local/lib/python3.8/site-packages/psutil/__init__.py", line 1432, in process_iter
    a = set(pids())
  File "/usr/local/lib/python3.8/site-packages/psutil/__init__.py", line 1372, in pids
    ret = sorted(_psplatform.pids())
  File "/usr/local/lib/python3.8/site-packages/psutil/_psbsd.py", line 512, in pids
    ret = cext.pids()
OSError: [Errno 12] Cannot allocate memory (originated from sysctl)
04/04/22 (23:39:28) | WARNING: Exiting with errorcode (1). Runtime 13:47:42

[giampaolo]

Ouch! This is bad. The error originates from here.

The fix should consist in calling the first sysctl() in a loop, and enlarge the buffer size if it returns ENOMEM. There are similar constructs elsewhere in psutil. I'm CCing @glebius and @kostikbel just in case they have some comments about this.

Since I've never seen this happening here's a question: how many processes are running on this machine? ps aux | wc -l should tell.