Remove costly python requirements on Raspberry Pi #7635
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
pullapprove
bot
requested review from
andy31415,
chrisdecenzo,
jelderton,
jmartinez-silabs,
LuDuda,
saurabhst and
woody-apple
yunhanw-google
approved these changes
Jun 15, 2021
mspang
force-pushed
the
for-chip/faster-pi-bootstrap
branch
from
a5a9371
to
81df840
Compare
Quentame
reviewed
Jun 15, 2021
LuDuda
approved these changes
Jun 15, 2021
It takes up to 1 hour to boostrap on Raspberry Pi, largely due to adding "pandas" which is expensive to build and doesn't have a linux aarch64 wheel on pypi. Remove packages with no wheels from the requirements on aarch64 to save time (pandas, gdbgui). This switches the compiled requirements.txt to a "constraints.txt" which is like a requirements file but only contains version constraints and does not automatically install its contents. That way, we can specify what version to use for packages on amd64 without forcing their installation on the Pi. See pip help install for more details on this feature. This reduces initial Pi 4 Python bootstrap down to ~4m from ~50m.
mspang
force-pushed
the
for-chip/faster-pi-bootstrap
branch
from
81df840
to
290a2e2
Compare
andy31415
approved these changes
Jun 15, 2021
jmartinez-silabs
approved these changes
Jun 15, 2021
woody-apple
approved these changes
Jun 15, 2021
nikita-s-wrk
pushed a commit
to nikita-s-wrk/connectedhomeip
that referenced
this pull request
Sep 23, 2021
It takes up to 1 hour to boostrap on Raspberry Pi, largely due to adding "pandas" which is expensive to build and doesn't have a linux aarch64 wheel on pypi. Remove packages with no wheels from the requirements on aarch64 to save time (pandas, gdbgui). This switches the compiled requirements.txt to a "constraints.txt" which is like a requirements file but only contains version constraints and does not automatically install its contents. That way, we can specify what version to use for packages on amd64 without forcing their installation on the Pi. See pip help install for more details on this feature. This reduces initial Pi 4 Python bootstrap down to ~4m from ~50m.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Problem
Bootstrap takes up to 1 hour to boostrap on Raspberry Pi, largely due to
adding "pandas" which is expensive to build and doesn't have a linux
aarch64 wheel on pypi.
Change overview
Remove packages with no wheels from the requirements on
aarch64 to save time (pandas, gdbgui).
This switches the compiled requirements.txt to a "constraints.txt" which
is like a requirements file but only contains version constraints and
does not automatically install its contents. That way, we can specify
what version to use for packages on amd64 without forcing their
installation on the Pi. See pip help install for more details on this
feature.
This reduces initial Pi 4 Python bootstrap down to ~4m from ~50m.
Testing
source scripts/bootstrap.shon Raspberry Pi