Fixes for the Airflow CI #4
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* REST API: Fix wrong plugin schema We serialize some plugin's fields as dictionaries leading to errors when accessing the `/plugins` endpoint. Here's the error: ValueError: dictionary update sequence element #0 has length 1; 2 is required The fields are lists of strings and this PR addresses it. * fixup! REST API: Fix wrong plugin schema * Add test at the endpoint * fixup! Add test at the endpoint
* Chart: Update default airflow version to 2.7.2 * fixup! Chart: Update default airflow version to 2.7.2
* Extend hooks arguments into `AwsBaseWaiterTrigger` * Use prune dictionary AwsBaseWaiterTrigger --------- Co-authored-by: Vincent Beck <vincbeck@amazon.com> * Add links to boto3 documentation in docstring * Add super() into the AwsBaseWaiterTrigger
…apache#34790) * Remove unused argument metadata from es_read * renaem underscore; add notes * Update airflow/providers/elasticsearch/CHANGELOG.rst Co-authored-by: Elad Kalif <45845474+eladkal@users.noreply.github.com> --------- Co-authored-by: Elad Kalif <45845474+eladkal@users.noreply.github.com>
…y. (apache#34627) * Error handling for broken or null Azure logs. * Updated logging syntax to match rest of the code. * Moved broken log checking closer to the source to avoid catching more general errors. * Fixed style issues. * Changed log exception to log error. * Changed failure case return type to list. Not an empty list as that ruins normal operation - instead [None. * Cleaner checking of logs list not being empty Co-authored-by: Wei Lee <weilee.rx@gmail.com> --------- Co-authored-by: Wei Lee <weilee.rx@gmail.com>
PIP recently started backtracking with constraint generation and in order to fix it, more thorough investigation is needed. Source constraints generation works fine, only PyPI one is a problem. We are disabling it now to fix it temporarily.
…Storage (apache#32779) * added config for container in azure blob remote logs --------- Co-authored-by: adaverse <adaverse@LAPTOP-JD3LRTNF> Co-authored-by: Elad Kalif <45845474+eladkal@users.noreply.github.com> Co-authored-by: adaverse <adaverse@Akash>
* Update RELEASE_NOTES.rst (cherry picked from commit c8b25cb) * Update airflow version in the necessary places
* Prepare docs 1st wave of Providers in October 2023 * add 34627 to azure provider * Change providers from patch to minor version * fixes * Add 32779 to azure * fix yandex CHANGELOG.rst
… section heading (apache#34925) To save time for people by letting them know up front that SubDag feature is deprecated and TaskGroup's should be used instead.
* Update system tests for Google Sheets operators * Update DAG for system tests
* Fixes apache#34816 Change the order of operations so that async child thread is created after forking when entering daemon context. This makes sure that the thread stays alive in the internal loop. --------- Co-authored-by: daniel.dylag <danieldylag1990@gmail.com>
WTForms 3.1.0 released 10th of October 2023 introduced a breaking change in the way QuerySelectChoices fields are handled. See details in dpgaspar/Flask-AppBuilder#2137
…pache#34946) The sentry-sdk 1.32.0 released on 11th of October fixed handling of utcnow to make it future-compatible with Python 3.12. The breadcrumb timestamp returned was naive and now it is timezone aware with utc specified explicitly as timezone. This broke our tests. The change in sentry that impacted it is getsentry/sentry-python#2415 We use the opportunity also to bump sentry sdk minimum version to be 1.32.0 from very old 0.8.0 (from 2019). Sentry is a service, so they generally always want you to use the latest version, and sentry has very little requirements on its own to cause conflicts (for Python 3.8+ it only requires "certifi" without any specific limitations)
* Fix the dags count filter in webserver home page * Add a test to avoid breaking the count in the future
Add Open Search Provider --------- Co-authored-by: Hussein Awala <hussein@awala.fr> Co-authored-by: D. Ferruzzi <ferruzzi@amazon.com>
…ion (apache#34912) Added reference to sentry "transport" configuration option and how to set it up.
This test started To fail ONLY on sqlite but only on self-hosted runners and locally (not on public runners) We should uncomment it when we figure out what's going on. Related: apache#35204
tatiana
force-pushed
the
databricks-jobs-create
branch
from
2c48958 to
bcb5d02
Compare
The azure-identity 1.15.0 introduced a change in the API call of the secret credential and started to fail our tests. This PR adds conditional test behaviour depending on the azure-identity version.
tatiana
force-pushed
the
databricks-jobs-create
branch
from
bcb5d02 to
7b04f5b
Compare
…pache#35129) * Added to the rendering of KubernetesOperator V1VolumeMount, sub_path
This adds the ObjectStorage and ObjectStorePath APIs per AIP-58. ObjectStorePath is a pathlib.Pathlib like interface for objects residing on object storage.
* fix(helm): set worker safeToEvict properly
…fic version ==0.10.0
…fic version ==0.10.0
This was agreed with @stikkireddy, since there the SDK interfaces are changing ATM. When it becomes stable, we can re-introduce this dependency
tatiana
force-pushed
the
databricks-jobs-create
branch
from
f75c975 to
043f692
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
20 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi @stikkireddy , some minor suggestions that aim to fix the issues raised in the Airflow CI:
https://github.com/apache/airflow/actions/runs/5866944508?pr=32221