Skip to content

Change update_deps script so that latest stable version can be pulled instead of latest nightly #9424

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jul 7, 2025

Conversation

bfolie
Copy link
Collaborator

@bfolie bfolie commented Jun 30, 2025

Given the decision to sync with a stable release, modifies the update_deps.py script to optionally determine the latest release of Jax and get the corresponding openxla hash and libtpu version.

Running the script changes the XLA hash from 9084478 to 3d5ece6. The latter is the XLA commit pinned by Jax 0.6.2, which is what we want. The former was the last commit on the day of the release. In this case they both work, but it's a nice verification that this script can get us a more compatible version with less effort.

Note that setup.py has a USE_NIGHTLY bool which, if False, will pull jax and jaxlib using their version numbers instead of pulling the corresponding nightly from the package registries. This seems like a change we want to make but doing so in this case fails with

ImportError: /home/runner/.local/lib/python3.10/site-packages/_XLAC.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c1010TensorImpl35is_non_overlapping_and_dense_customEv

This failure is because we are missing symbol sym_is_non_overlapping_and_dense_custom, introduced a few days ago here. So we're using an older, stable version of pytorch. I don't understand why this is the case, based on setup.py. But in the meantime I keep USE_NIGHTLY as True. This means we're still technically pulling a nightly version, but it's the nightly built from the most recent stable Jax version.

@bfolie bfolie changed the title Change update_deps script so that latest stable version can be pulled instead of nightly Change update_deps script so that latest stable version can be pulled instead of latest nightly Jun 30, 2025
@qihqi qihqi merged commit 66ad14f into master Jul 7, 2025
23 of 24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants