Update to 3.14.0b1 #610

zanieb · 2025-05-17T02:12:58Z

gh-132983: Introduce _zstd bindings module python/cpython#133027
GH-132983: Build _zstd on Windows python/cpython#133366
GH-91048: Add utils for printing the call stack for asyncio tasks python/cpython#133284
GH-91048: Minor fixes for _remotedebugging & rename to _remote_debugging python/cpython#133398
Undefined references to HACL symbols when statically linking Python 3.12 python/cpython#131298
gh-131298: eliminate HACL* static libraries for cryptographic modules python/cpython#132438
gh-131298: update Modules/Setup after HACL static linking changes python/cpython#133012

zanieb · 2025-05-17T02:26:45Z

A couple new extension modules

2025-05-17T02:24:39.4965485Z Traceback (most recent call last):
2025-05-17T02:24:39.5035664Z   File "/home/runner/work/python-build-standalone/python-build-standalone/cpython-unix/build.py", line 1307, in <module>
2025-05-17T02:24:39.5036416Z     sys.exit(main())
2025-05-17T02:24:39.5036632Z              ^^^^^^
2025-05-17T02:24:39.5037103Z   File "/home/runner/work/python-build-standalone/python-build-standalone/cpython-unix/build.py", line 1289, in main
2025-05-17T02:24:39.5037637Z     build_cpython(
2025-05-17T02:24:39.5038102Z   File "/home/runner/work/python-build-standalone/python-build-standalone/cpython-unix/build.py", line 764, in build_cpython
2025-05-17T02:24:39.5038589Z     setup = derive_setup_local(
2025-05-17T02:24:39.5038823Z             ^^^^^^^^^^^^^^^^^^^
2025-05-17T02:24:39.5039313Z   File "/home/runner/work/python-build-standalone/python-build-standalone/pythonbuild/cpython.py", line 388, in derive_setup_local
2025-05-17T02:24:39.5039811Z     raise Exception(
2025-05-17T02:24:39.5040120Z Exception: missing extension modules from YAML: _remote_debugging, _zstd

zanieb · 2025-05-17T20:33:00Z

Alright, now we need to setup zstd

cpython-3.14> make: *** No rule to make target `Modules/_zstd/zdict.c', needed by `Modules/_zstd/zdict.o'.  Stop.
cpython-3.14> make: *** Waiting for unfinished jobs....
cpython-3.14> In file included from ./Modules/_zstd/_zstdmodule.c:10:
cpython-3.14> ./Modules/_zstd/_zstdmodule.h:11:10: fatal error: 'zstd.h' file not found
cpython-3.14>    11 | #include "zstd.h"
cpython-3.14>       |          ^~~~~~~~
cpython-3.14> 1 error generated.
cpython-3.14> make: *** [Modules/_zstd/_zstdmodule.o] Error 1
cpython-3.14> 1 warning generated.

cclauss · 2025-05-27T07:25:11Z

Beta 2: https://www.python.org/downloads/release/python-3140b2/

geofft · 2025-05-30T07:24:35Z

Linux builds should hopefully be good now, if that validation change did what I expected.

Mac builds are failing because patch-jit-cflags-314.patch in #544 doesn't quite apply to b1 - Zanie, I'll let you handle that (and maybe you want to try b2 at the same time). If you rebase this branch on top of main, note that 867ca9c reverts fab9ad2, b01c183, and 856ce7e so personally I would ditch all four commits.

zanieb · 2025-05-30T12:26:55Z

Thanks! I'll look at that patch

zanieb · 2025-05-30T16:09:03Z

Windows failing due to some zstd stuff, e.g.:

cpython>          C:\Users\runneradmin\AppData\Local\Temp\python-build-pg4chnf6\Python-3.14.0b1\externals\zstd-1.5.7\lib\dictBuilder\cover.c(1,1): error C1083: Cannot open source file: 'C:\Users\runneradmin\AppData\Local\Temp\python-build-pg4chnf6\Python-3.14.0b1\externals\zstd-1.5.7\lib\dictBuilder\cover.c': No such file or directory [C:\Users\RUNNER~1\AppData\Local\Temp\python-build-pg4chnf6\Python-3.14.0b1\PCbuild\_zstd.vcxproj]

zanieb · 2025-05-30T21:21:45Z

cpython-unix/build-cpython.sh

@@ -466,7 +466,8 @@ if [ -n "${CPYTHON_OPTIMIZED}" ]; then

        # Do not enable on x86-64 macOS because the JIT requires macOS 11+ and we are currently
        # using 10.15 as a miniumum version.
-        if [ "${TARGET_TRIPLE}" != "x86_64-apple-darwin" ]; then
+        # Do not enable when free-threading, because they're not compatible yet.


This just "didn't work" in previous releases, now they made it a hard error.

zanieb · 2025-05-30T21:22:13Z

cpython-unix/build-cpython.sh

@@ -588,6 +589,13 @@ if [[ -n "${PYTHON_MEETS_MINIMUM_VERSION_3_14}" && -n "${CROSS_COMPILING}" && "$
    export PROFILE_TASK='-m test --pgo --ignore test_strftime_y2k'
 fi

+# ./configure tries to auto-detect whether it can build 128-bit and 256-bit SIMD helpers for HACL,
+# but on x86-64 that requires v2 and v3 respectively, and on arm64 the performance is bad as noted
+# in the comments, so just don't even try. (We should check if we can make this conditional)


@geofft can you open an issue to track this?

#645. Let's add a link in this comment if we rework this PR.

zanieb · 2025-05-30T21:22:43Z

cpython-unix/extension-modules.yml

@@ -769,6 +771,17 @@ _xxtestfuzz:
    - _xxtestfuzz/_xxtestfuzz.c
    - _xxtestfuzz/fuzzer.c

+_zstd:
+  # Disable on all targets until we add a zstd library


This will need to come before stable, I can open an issue.

Created #646 so we don't forget, feel free to edit/rephrase.

geofft · 2025-06-04T15:58:40Z

cpython-unix/build-cpython.sh

@@ -588,6 +589,13 @@ if [[ -n "${PYTHON_MEETS_MINIMUM_VERSION_3_14}" && -n "${CROSS_COMPILING}" && "$
    export PROFILE_TASK='-m test --pgo --ignore test_strftime_y2k'
 fi

+# ./configure tries to auto-detect whether it can build 128-bit and 256-bit SIMD helpers for HACL,
+# but on x86-64 that requires v2 and v3 respectively, and on arm64 the performance is bad as noted
+# in the comments, so just don't even try. (We should check if we can make this conditional)


#645. Let's add a link in this comment if we rework this PR.

geofft · 2025-06-04T16:00:34Z

cpython-unix/patch-jit-cflags-314.patch

Should we send this patch upstream for inclusion in 3.14?

There's a patch at python/cpython#134276

zanieb marked this pull request as draft May 17, 2025 02:13

zanieb changed the title ~~Update to 3.14b1~~ Update to 3.14.0b1 May 17, 2025

zanieb added the python:3.14 label May 17, 2025

zanieb force-pushed the zb/14b1 branch from 33246b8 to a4edc60 Compare May 17, 2025 02:14

Base automatically changed from zb/14a7 to main May 17, 2025 03:37

zanieb force-pushed the zb/14b1 branch 5 times, most recently from 8e5c165 to 185c89b Compare May 17, 2025 20:26

henryiii mentioned this pull request May 22, 2025

docs: color output for docs pypa/cibuildwheel#2407

Merged

geofft force-pushed the zb/14b1 branch from 1e951b9 to 7adb1e0 Compare May 30, 2025 06:44

Wingysam and others added 9 commits May 30, 2025 07:33

Update to 3.14b1

a473674

Add _remote_debugging

88469ad

Add _zstd

5a259c1

Add _contextvars as config-c-only

a1ace54

Drop _testexternalinspection

414e4a1

Disable zstd for now

d081a85

fix missing symbols

b069848

_testexternalinspection turned into (public) remote_debugging

c023f00

Update JIT patch for b1

f5a7bac

zanieb force-pushed the zb/14b1 branch from f6d30c2 to f5a7bac Compare May 30, 2025 12:33

geofft and others added 2 commits May 30, 2025 07:35

a theory

4a5724d

Disable the JIT on free-threaded builds

d9f5072

Add zstd to Windows

04ad6e9

zanieb force-pushed the zb/14b1 branch from bee3baa to 04ad6e9 Compare May 30, 2025 16:18

Updated known projects for Windows

63f0d94

zanieb force-pushed the zb/14b1 branch from 6f60faf to 63f0d94 Compare May 30, 2025 17:37

Move _zstd to built-in module list

cff40b2

zanieb added the python:3.13 label May 30, 2025

zanieb commented May 30, 2025

View reviewed changes

This comment was marked as spam.

Sign in to view

Add _zstd to expected modules on Windows

bca7d94

zanieb marked this pull request as ready for review June 4, 2025 15:39

geofft mentioned this pull request Jun 4, 2025

Address HACL SIMD compilation in a better way #645

Open

geofft approved these changes Jun 4, 2025

View reviewed changes

zanieb merged commit d2030cb into main Jun 4, 2025
211 checks passed

zanieb deleted the zb/14b1 branch June 4, 2025 16:20

zanieb mentioned this pull request Jun 4, 2025

Update to 3.14.0b1 #602

Closed

cclauss mentioned this pull request Jun 4, 2025

Python 3.14.0 beta 1 is here! astral-sh/uv#13362

Open

Uh oh!

Update to 3.14.0b1 #610

Update to 3.14.0b1 #610

Uh oh!

Conversation

zanieb commented May 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

zanieb commented May 17, 2025

Uh oh!

zanieb commented May 17, 2025

Uh oh!

cclauss commented May 27, 2025

Uh oh!

geofft commented May 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

zanieb commented May 30, 2025

Uh oh!

zanieb commented May 30, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

This comment was marked as spam.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

zanieb commented May 17, 2025 •

edited

Loading

geofft commented May 30, 2025 •

edited

Loading