Updates 3.6 limits for latest versions of a few libraries #15209
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This PR sets Pythong 3.6 specific limits for some of the packages that recently dropped support for Python 3.6 binary packages released via PyPI. Even if those packages did not drop the Python 3.6 support entirely, it gets more and more difficult to get those packages installed (both locally and in the Docker image) because the require the packages to be compiled and they often require a number of external dependencies to do so. This makes it difficult to automatically upgrade dependencies, because such upgrade fails for Python 3.6 images if we attempt to do so. This PR limits several of those dependencies (dask/pandas/numpy) to not use the lates major releases for those packages but limits them to the latest released versions. Also comment/clarification was added to recently (apache#15114) added limit for `pandas-gbq`. This limit has been added because of broken import for bigquery provider, but the comment about it was missing so the comment is added now.
potiuk
force-pushed
the
upgrade-to-latest-constraints-april-2021
branch
from
aef09a4 to
554e840
Compare
dimberman
approved these changes
Apr 5, 2021
kaxil
approved these changes
Apr 5, 2021
potiuk
added a commit
to potiuk/airflow
that referenced
this pull request
Apr 5, 2021
After updating constraints manually, pushing it quickly without waiting for master build to succeed. Limits updated in: apache#15209
potiuk
added a commit
that referenced
this pull request
Apr 5, 2021
This PR sets Pythong 3.6 specific limits for some of the packages that recently dropped support for Python 3.6 binary packages released via PyPI. Even if those packages did not drop the Python 3.6 support entirely, it gets more and more difficult to get those packages installed (both locally and in the Docker image) because the require the packages to be compiled and they often require a number of external dependencies to do so. This makes it difficult to automatically upgrade dependencies, because such upgrade fails for Python 3.6 images if we attempt to do so. This PR limits several of those dependencies (dask/pandas/numpy) to not use the lates major releases for those packages but limits them to the latest released versions. Also comment/clarification was added to recently (#15114) added limit for `pandas-gbq`. This limit has been added because of broken import for bigquery provider, but the comment about it was missing so the comment is added now. (cherry picked from commit e497228)
ashb
pushed a commit
that referenced
this pull request
Apr 15, 2021
This PR sets Pythong 3.6 specific limits for some of the packages that recently dropped support for Python 3.6 binary packages released via PyPI. Even if those packages did not drop the Python 3.6 support entirely, it gets more and more difficult to get those packages installed (both locally and in the Docker image) because the require the packages to be compiled and they often require a number of external dependencies to do so. This makes it difficult to automatically upgrade dependencies, because such upgrade fails for Python 3.6 images if we attempt to do so. This PR limits several of those dependencies (dask/pandas/numpy) to not use the lates major releases for those packages but limits them to the latest released versions. Also comment/clarification was added to recently (#15114) added limit for `pandas-gbq`. This limit has been added because of broken import for bigquery provider, but the comment about it was missing so the comment is added now. (cherry picked from commit e497228)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR sets Pythong 3.6 specific limits for some of the packages
that recently dropped support for Python 3.6 binary packages
released via PyPI. Even if those packages did not drop the
Python 3.6 support entirely, it gets more and more difficult to
get those packages installed (both locally and in the Docker image)
because the require the packages to be compiled and they often
require a number of external dependencies to do so.
This makes it difficult to automatically upgrade dependencies,
because such upgrade fails for Python 3.6 images if we attempt
to do so.
This PR limits several of those dependencies (dask/pandas/numpy)
to not use the lates major releases for those packages but limits
them to the latest released versions.
Also comment/clarification was added to recently (#15114) added limit
for
pandas-gbq. This limit has been added because of brokenimport for bigquery provider, but the comment about it was missing
so the comment is added now.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.