Python built with clang -O0 allocates 10x more stack memory than clang -O3 on a Python function call

[vstinner]

BPO	46600
Nosy	@vstinner, @methane, @corona10, @pablogsal
PRs	bpo-46600: ./configure --with-pydebug uses -Og with clang #31052 bpo-46600: Fix test_gdb.test_pycfunction() for clang -Og #31058
Files	stack_overflow-4.py

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2022-02-01.13:06:00.875>
labels = ['3.11', 'build', 'performance']
title = 'Python built with clang -O0 allocates 10x more stack memory than clang -O3 on a Python function call'
updated_at = <Date 2022-02-03.00:00:28.611>
user = 'https://github.com/vstinner'

bugs.python.org fields:

activity = <Date 2022-02-03.00:00:28.611>
actor = 'methane'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Build']
creation = <Date 2022-02-01.13:06:00.875>
creator = 'vstinner'
dependencies = []
files = ['50600']
hgrepos = []
issue_num = 46600
keywords = ['patch']
message_count = 14.0
messages = ['412252', '412253', '412254', '412255', '412256', '412258', '412260', '412261', '412278', '412286', '412294', '412334', '412348', '412407']
nosy_count = 4.0
nosy_names = ['vstinner', 'methane', 'corona10', 'pablogsal']
pr_nums = ['31052', '31058']
priority = 'normal'
resolution = None
stage = 'patch review'
status = 'open'
superseder = None
type = 'performance'
url = 'https://bugs.python.org/issue46600'
versions = ['Python 3.11']

[vstinner]

Measure using this script on the main branch (commit 108e66b):
---

import _testcapi
def f(): yield _testcapi.stack_pointer()
print(_testcapi.stack_pointer() - next(f()))

---

Stack usage depending on the compiler and compiler optimization level:

• clang -O0: 9,104 bytes
• clang -Og: 736 bytes
• gcc -O0: 6,784 bytes
• gcc -Og: 624 bytes

-O0 allocates around 10x more memory.

Moreover, "./configure --with-pydebug CC=clang" uses -O0 in CFLAGS, because "clang --help" output doesn't containt "-Og". I'm working on a configure change to use -Og on clang which supports it.

[vstinner]

#75235 enables -Og when using clang and ./configure --with-pydebug and so the example uses 736 bytes instead of 9,104 bytes.

[vstinner]

This issue is a follow-up of bpo-46542 "test_json and test_lib2to3 crash on s390x Fedora Clang 3.x buildbot".

[vstinner]

Previous issues about stack memory usage, work done in 2017:

• bpo-28870: Reduce stack consumption of PyObject_CallFunctionObjArgs() and like
• bpo-29227: Reduce C stack consumption in function calls
• bpo-29465: Modify _PyObject_FastCall() to reduce stack consumption
  29464

I summarized the results in the "Stack consumption" section of my article: https://vstinner.github.io/contrib-cpython-2017q1.html

[vstinner]

See also bpo-30866: "Add _testcapi.stack_pointer() to measure the C stack consumption".

[vstinner]

stack_overflow-4.py: Update script from bpo-30866 to measure stack memory usage before Python crash or raises a RecursionError.

I had to modify the script since calling a Python function from a Python function no longer allocates (additional) memory on the stack! See bpo-45256 "Remove the usage of the C stack in Python to Python calls".

[vstinner]

stack_overflow-4.py output depending on the compiler and compiler flags.

gcc -O3 (./configure):
---
test_python_call: 11904 calls before crash, stack: 704.1 bytes/call
test_python_iterator: 17460 calls before crash, stack: 480.0 bytes/call
test_python_getitem: 245760 calls before recursion error, stack: 0.2 bytes/call

=> total: 275124 calls, 1184.3 bytes per call
---

It's better than stack memory usage in 2017: https://bugs.python.org/issue30866#msg297826

clang -O3 (./configure CC=clang):
---
test_python_call: 10270 calls before crash, stack: 816.1 bytes/call
test_python_iterator: 14155 calls before crash, stack: 592.0 bytes/call
test_python_getitem: 245760 calls before recursion error, stack: 0.3 bytes/call

=> total: 270185 calls, 1408.4 bytes per call
---

clang allocates a little bit more memory on the stack than gcc.

I didn't try PGO or LTO yet.

[vstinner]

New changeset 0515eaf by Victor Stinner in branch 'main':
bpo-46600: ./configure --with-pydebug uses -Og with clang (GH-31052)
0515eaf

[pablogsal]

PR 31052 seems to have broken a bunch of buildbots. If no fix is provided in 24 hours, we will need to revert :(