Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump apache-airflow from 2.8.1 to 2.9.0 in /integration/airflow #3798

Merged

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Apr 18, 2024

Bumps apache-airflow from 2.8.1 to 2.9.0.

Release notes

Sourced from apache-airflow's releases.

Apache Airflow 2.9.0

Significant Changes

Following Listener API methods are considered stable and can be used for production system (were experimental feature in older Airflow versions) (#36376):

Lifecycle events:

  • on_starting
  • before_stopping

DagRun State Change Events:

  • on_dag_run_running
  • on_dag_run_success
  • on_dag_run_failed

TaskInstance State Change Events:

  • on_task_instance_running
  • on_task_instance_success
  • on_task_instance_failed

Support for Microsoft SQL-Server for Airflow Meta Database has been removed (#36514)

After discussion <https://lists.apache.org/thread/r06j306hldg03g2my1pd4nyjxg78b3h4>__ and a voting process <https://lists.apache.org/thread/pgcgmhf6560k8jbsmz8nlyoxosvltph2>__, the Airflow's PMC and Committers have reached a resolution to no longer maintain MsSQL as a supported Database Backend.

As of Airflow 2.9.0 support of MsSQL has been removed for Airflow Database Backend.

A migration script which can help migrating the database before upgrading to Airflow 2.9.0 is available in airflow-mssql-migration repo on Github <https://github.com/apache/airflow-mssql-migration>_. Note that the migration script is provided without support and warranty.

This does not affect the existing provider packages (operators and hooks), DAGs can still access and process data from MsSQL.

Dataset URIs are now validated on input (#37005)

Datasets must use a URI that conform to rules laid down in AIP-60, and the value will be automatically normalized when the DAG file is parsed. See documentation on Datasets <https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html>_ for a more detailed description on the rules.

You may need to change your Dataset identifiers if they look like a URI, but are used in a less mainstream way, such as relying on the URI's auth section, or have a case-sensitive protocol name.

The method get_permitted_menu_items in BaseAuthManager has been renamed filter_permitted_menu_items (#37627)

Add REST API actions to Audit Log events (#37734)

... (truncated)

Changelog

Sourced from apache-airflow's changelog.

Airflow 2.9.0 (2024-04-08)

Significant Changes ^^^^^^^^^^^^^^^^^^^

Following Listener API methods are considered stable and can be used for production system (were experimental feature in older Airflow versions) (#36376): """""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""" Lifecycle events:

  • on_starting
  • before_stopping

DagRun State Change Events:

  • on_dag_run_running
  • on_dag_run_success
  • on_dag_run_failed

TaskInstance State Change Events:

  • on_task_instance_running
  • on_task_instance_success
  • on_task_instance_failed

Support for Microsoft SQL-Server for Airflow Meta Database has been removed (#36514) """"""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""""

After discussion <https://lists.apache.org/thread/r06j306hldg03g2my1pd4nyjxg78b3h4>__ and a voting process <https://lists.apache.org/thread/pgcgmhf6560k8jbsmz8nlyoxosvltph2>__, the Airflow's PMC and Committers have reached a resolution to no longer maintain MsSQL as a supported Database Backend.

As of Airflow 2.9.0 support of MsSQL has been removed for Airflow Database Backend.

A migration script which can help migrating the database before upgrading to Airflow 2.9.0 is available in airflow-mssql-migration repo on Github <https://github.com/apache/airflow-mssql-migration>_. Note that the migration script is provided without support and warranty.

This does not affect the existing provider packages (operators and hooks), DAGs can still access and process data from MsSQL.

Dataset URIs are now validated on input (#37005) """"""""""""""""""""""""""""""""""""""""""""""""

Datasets must use a URI that conform to rules laid down in AIP-60, and the value will be automatically normalized when the DAG file is parsed. See documentation on Datasets <https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html>_ for a more detailed description on the rules.

You may need to change your Dataset identifiers if they look like a URI, but are used in a less mainstream way, such as relying on the URI's auth section, or

... (truncated)

Commits

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    You can disable automated security fix PRs for this repo from the Security Alerts page.

Bumps [apache-airflow](https://github.com/apache/airflow) from 2.8.1 to 2.9.0.
- [Release notes](https://github.com/apache/airflow/releases)
- [Changelog](https://github.com/apache/airflow/blob/main/RELEASE_NOTES.rst)
- [Commits](apache/airflow@2.8.1...2.9.0)

---
updated-dependencies:
- dependency-name: apache-airflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file python Pull requests that update Python code labels Apr 18, 2024
Copy link
Contributor

coderabbitai bot commented Apr 18, 2024

Important

Auto Review Skipped

Bot user detected.

To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.


Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

Share
Tips

Chat

There are 3 ways to chat with CodeRabbit:

  • Review comments: Directly reply to a review comment made by CodeRabbit. Example:
    • I pushed a fix in commit <commit_id>.
    • Generate unit testing code for this file.
    • Open a follow-up GitHub issue for this discussion.
  • Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
    • @coderabbitai generate unit testing code for this file.
    • @coderabbitai modularize this function.
  • PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
    • @coderabbitai generate interesting stats about this repository and render them as a table.
    • @coderabbitai show all the console.log statements in this repository.
    • @coderabbitai read src/utils.ts and generate unit testing code.
    • @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (invoked as PR comments)

  • @coderabbitai pause to pause the reviews on a PR.
  • @coderabbitai resume to resume the paused reviews.
  • @coderabbitai review to trigger a review. This is useful when automatic reviews are disabled for the repository.
  • @coderabbitai resolve resolve all the CodeRabbit review comments.
  • @coderabbitai help to get help.

Additionally, you can add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.

CodeRabbit Configration File (.coderabbit.yaml)

  • You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
  • Please see the configuration documentation for more information.
  • If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json

Documentation and Community

  • Visit our Documentation for detailed information on how to use CodeRabbit.
  • Join our Discord Community to get help, request features, and share feedback.
  • Follow us on X/Twitter for updates and announcements.

@github-actions github-actions bot enabled auto-merge (squash) April 18, 2024 17:00
@github-actions github-actions bot merged commit a4c5003 into main Apr 27, 2024
14 checks passed
@github-actions github-actions bot deleted the dependabot/pip/integration/airflow/apache-airflow-2.9.0 branch April 27, 2024 21:15
aronchick added a commit that referenced this pull request Apr 27, 2024
Bumps [apache-airflow](https://github.com/apache/airflow) from 2.8.1 to
2.9.0.
<details>
<summary>Release notes</summary>
<p><em>Sourced from <a
href="https://github.com/apache/airflow/releases">apache-airflow's
releases</a>.</em></p>
<blockquote>
<h2>Apache Airflow 2.9.0</h2>
<h2>Significant Changes</h2>
<h2>Following Listener API methods are considered stable and can be used
for production system (were experimental feature in older Airflow
versions) (<a
href="https://redirect.github.com/apache/airflow/issues/36376">#36376</a>):</h2>
<p>Lifecycle events:</p>
<ul>
<li><code>on_starting</code></li>
<li><code>before_stopping</code></li>
</ul>
<p>DagRun State Change Events:</p>
<ul>
<li><code>on_dag_run_running</code></li>
<li><code>on_dag_run_success</code></li>
<li><code>on_dag_run_failed</code></li>
</ul>
<p>TaskInstance State Change Events:</p>
<ul>
<li><code>on_task_instance_running</code></li>
<li><code>on_task_instance_success</code></li>
<li><code>on_task_instance_failed</code></li>
</ul>
<h2>Support for Microsoft SQL-Server for Airflow Meta Database has been
removed (<a
href="https://redirect.github.com/apache/airflow/issues/36514">#36514</a>)</h2>
<p>After <code>discussion
&lt;https://lists.apache.org/thread/r06j306hldg03g2my1pd4nyjxg78b3h4&gt;</code>__
and a <code>voting process
&lt;https://lists.apache.org/thread/pgcgmhf6560k8jbsmz8nlyoxosvltph2&gt;</code>__,
the Airflow's PMC and Committers have reached a resolution to no longer
maintain MsSQL as a supported Database Backend.</p>
<p>As of Airflow 2.9.0 support of MsSQL has been removed for Airflow
Database Backend.</p>
<p>A migration script which can help migrating the database
<em>before</em> upgrading to Airflow 2.9.0 is available in
<code>airflow-mssql-migration repo on Github
&lt;https://github.com/apache/airflow-mssql-migration&gt;</code>_.
Note that the migration script is provided without support and
warranty.</p>
<p>This does not affect the existing provider packages (operators and
hooks), DAGs can still access and process data from MsSQL.</p>
<h2>Dataset URIs are now validated on input (<a
href="https://redirect.github.com/apache/airflow/issues/37005">#37005</a>)</h2>
<p>Datasets must use a URI that conform to rules laid down in AIP-60,
and the value
will be automatically normalized when the DAG file is parsed. See
<code>documentation on Datasets
&lt;https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html&gt;</code>_
for
a more detailed description on the rules.</p>
<p>You may need to change your Dataset identifiers if they look like a
URI, but are
used in a less mainstream way, such as relying on the URI's auth
section, or
have a case-sensitive protocol name.</p>
<h2>The method <code>get_permitted_menu_items</code> in
<code>BaseAuthManager</code> has been renamed
<code>filter_permitted_menu_items</code> (<a
href="https://redirect.github.com/apache/airflow/issues/37627">#37627</a>)</h2>
<h2>Add REST API actions to Audit Log events (<a
href="https://redirect.github.com/apache/airflow/issues/37734">#37734</a>)</h2>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Changelog</summary>
<p><em>Sourced from <a
href="https://github.com/apache/airflow/blob/main/RELEASE_NOTES.rst">apache-airflow's
changelog</a>.</em></p>
<blockquote>
<h2>Airflow 2.9.0 (2024-04-08)</h2>
<p>Significant Changes
^^^^^^^^^^^^^^^^^^^</p>
<p>Following Listener API methods are considered stable and can be used
for production system (were experimental feature in older Airflow
versions) (<a
href="https://redirect.github.com/apache/airflow/issues/36376">#36376</a>):

&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;
Lifecycle events:</p>
<ul>
<li><code>on_starting</code></li>
<li><code>before_stopping</code></li>
</ul>
<p>DagRun State Change Events:</p>
<ul>
<li><code>on_dag_run_running</code></li>
<li><code>on_dag_run_success</code></li>
<li><code>on_dag_run_failed</code></li>
</ul>
<p>TaskInstance State Change Events:</p>
<ul>
<li><code>on_task_instance_running</code></li>
<li><code>on_task_instance_success</code></li>
<li><code>on_task_instance_failed</code></li>
</ul>
<p>Support for Microsoft SQL-Server for Airflow Meta Database has been
removed (<a
href="https://redirect.github.com/apache/airflow/issues/36514">#36514</a>)

&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;</p>
<p>After <code>discussion
&lt;https://lists.apache.org/thread/r06j306hldg03g2my1pd4nyjxg78b3h4&gt;</code>__
and a <code>voting process
&lt;https://lists.apache.org/thread/pgcgmhf6560k8jbsmz8nlyoxosvltph2&gt;</code>__,
the Airflow's PMC and Committers have reached a resolution to no longer
maintain MsSQL as a supported Database Backend.</p>
<p>As of Airflow 2.9.0 support of MsSQL has been removed for Airflow
Database Backend.</p>
<p>A migration script which can help migrating the database
<em>before</em> upgrading to Airflow 2.9.0 is available in
<code>airflow-mssql-migration repo on Github
&lt;https://github.com/apache/airflow-mssql-migration&gt;</code>_.
Note that the migration script is provided without support and
warranty.</p>
<p>This does not affect the existing provider packages (operators and
hooks), DAGs can still access and process data from MsSQL.</p>
<p>Dataset URIs are now validated on input (<a
href="https://redirect.github.com/apache/airflow/issues/37005">#37005</a>)

&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;&quot;</p>
<p>Datasets must use a URI that conform to rules laid down in AIP-60,
and the value
will be automatically normalized when the DAG file is parsed. See
<code>documentation on Datasets
&lt;https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html&gt;</code>_
for
a more detailed description on the rules.</p>
<p>You may need to change your Dataset identifiers if they look like a
URI, but are
used in a less mainstream way, such as relying on the URI's auth
section, or</p>
<!-- raw HTML omitted -->
</blockquote>
<p>... (truncated)</p>
</details>
<details>
<summary>Commits</summary>
<ul>
<li><a
href="https://github.com/apache/airflow/commit/50f22ffe9150e93f7fc08a9dc8a48880daad374b"><code>50f22ff</code></a>
fixup! fixup! Update RELEASE_NOTES.rst</li>
<li><a
href="https://github.com/apache/airflow/commit/3a9391c3a1cf7597dd85cad28cf1738d634df391"><code>3a9391c</code></a>
Update hatchling to latest version (1.22.5) (<a
href="https://redirect.github.com/apache/airflow/issues/38780">#38780</a>)</li>
<li><a
href="https://github.com/apache/airflow/commit/35684a82a430e459362aab5bcdd79480cbb25ddd"><code>35684a8</code></a>
Rename pre-commit scripts, drop pre_commit_ prefix (<a
href="https://redirect.github.com/apache/airflow/issues/38667">#38667</a>)</li>
<li><a
href="https://github.com/apache/airflow/commit/b38575a5a445ea36fb8fdb1c6fd75ffe7543ad56"><code>b38575a</code></a>
fixup! Update RELEASE_NOTES.rst</li>
<li><a
href="https://github.com/apache/airflow/commit/a3eb5f73d617b7482fdcc81a888e3599f1f63d75"><code>a3eb5f7</code></a>
Load providers configuration when gunicorn workers start (<a
href="https://redirect.github.com/apache/airflow/issues/38795">#38795</a>)</li>
<li><a
href="https://github.com/apache/airflow/commit/920921ee39736c96e9cf7c544657ca75c7a6365a"><code>920921e</code></a>
Update RELEASE_NOTES.rst</li>
<li><a
href="https://github.com/apache/airflow/commit/cbe61bc0cc028efe2657db1841b9371230eaa7e5"><code>cbe61bc</code></a>
Fix decryption of trigger kwargs when downgrading. (<a
href="https://redirect.github.com/apache/airflow/issues/38743">#38743</a>)</li>
<li><a
href="https://github.com/apache/airflow/commit/1fdfaf329fbde7660257eb35bb7b181e7ab6b6a0"><code>1fdfaf3</code></a>
Edited timetable docs (<a
href="https://redirect.github.com/apache/airflow/issues/38505">#38505</a>)</li>
<li><a
href="https://github.com/apache/airflow/commit/0518ebab6891efee39dae4b89e4a70e0c7345c1b"><code>0518eba</code></a>
Fix grid header rendering (<a
href="https://redirect.github.com/apache/airflow/issues/38720">#38720</a>)</li>
<li><a
href="https://github.com/apache/airflow/commit/0961e4290cffc1fa61517a51c68307459c7aaec4"><code>0961e42</code></a>
Reorder OpenAPI Spec tags alphabetically (<a
href="https://redirect.github.com/apache/airflow/issues/38717">#38717</a>)</li>
<li>Additional commits viewable in <a
href="https://github.com/apache/airflow/compare/2.8.1...2.9.0">compare
view</a></li>
</ul>
</details>
<br />


[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=apache-airflow&package-manager=pip&previous-version=2.8.1&new-version=2.9.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
You can disable automated security fix PRs for this repo from the
[Security Alerts
page](https://github.com/bacalhau-project/bacalhau/network/alerts).

</details>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: David Aronchick <aronchick@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file python Pull requests that update Python code
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant