Status of testing Providers that were prepared on May 30, 2024

[eladkal]

Body

I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?

The guidelines on how to test providers can be found in

Verify providers by contributors

Let us know in the comment, whether the issue is addressed.

Those are providers that require testing as there were some substantial changes introduced:

Provider amazon: 8.24.0rc1

• ECS Overrides for AWS Batch submit_job (#39903): @yehoshuadimarsky
• feat: implement amazon s3 to dynamodb transfer operator (#39654): @dondaum
  Linked issues:
  • Linked Issue #39377: @eladkal
• Resolving ECS fargate deprecated warnings (#39834): @dirrao

Provider cncf.kubernetes: 8.3.0rc2

• Add timeout when watching pod events in k8s executor (#39551): @dstandish
• Add retry logic for KubernetesCreateResourceOperator and KubernetesJobOperator (#39201): @MaksYermak
• Fix deprecated calls in cncf.kubernetes provider (#39381): @Taragolis
  Linked issues:
  • Linked Issue #38642: @Taragolis
  • Linked Issue #39356: @bmoon4
• Handling exception getting logs when pods finish success (#39296): @antoniocorralsierra
  Linked issues:
  • Linked Issue #39239: @antoniocorralsierra
• remove unexpected argument pod in read_namespaced_pod_log call (#39874): @Lee-W
• Move Kubernetes cli to provider package (#39587): @romsharon98
• Remove compat code for 2.7.0 - its now the min Airflow version (#39591): @jedcunningham
• Replace pod_manager.read_pod_logs with client.read_namespaced_pod_log in KubernetesPodOperator._write_logs (#39112): @Lee-W
• Add a warning message to KPO to warn of one second interval logs duplication (#39861): @fdemiane
  Linked issues:
  • Linked Issue #33500: @fdemiane
  • Linked Issue #39236: @Nikita-Sobolev

Provider teradata: 2.2.0rc1

• Updates to Teradata Provider (#39217): @satish-chinthanippu

All users involved in the PRs:
@Taragolis @MaksYermak @dstandish @fdemiane @yehoshuadimarsky @antoniocorralsierra @satish-chinthanippu @romsharon98 @dirrao @Lee-W @dondaum

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[Lee-W]

Tested #39112, #39874. Worked as expected

[yehoshuadimarsky]

I tested it, there is a small issue. Turns out that the ECS parameters override that I added was only added to Boto3 starting in version 1.34.52, so it won't work if Boto3 is an earlier version. Should I make another PR to either note that in the docs / raise an error or warning if it detects an old Boto3 version?

[sc250072]

Tested #39217. Worked as expected

[yehoshuadimarsky]

Opened #39983

[eladkal]

Thank you everyone. Providers are released.
Amazon provider is excluded from this release and will have rc2 once issues found on rc1 are resolved

I invite everyone to help improve providers for the next release, a list of open issues can be found here.

[sc250072]

@eladkal https://airflow.apache.org/docs/apache-airflow-providers-teradata/stable/commits.html - Teradata still on old version.

[eladkal]

@eladkal https://airflow.apache.org/docs/apache-airflow-providers-teradata/stable/commits.html - Teradata still on old version.

Airflow doc site takes time to be built. it's OK