Status of testing Providers that were prepared on September 05, 2022

[ashb]

Body

I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?

Let us know in the comment, whether the issue is addressed.

Those are providers that require testing as there were some substantial changes introduced:

Provider amazon: 5.1.0rc1

• Additional mask AWS Credentials (#26014): @Taragolis
• Add RedshiftDeleteClusterSnapshotOperator (#25975): @pankajastro
• Add redshift create cluster snapshot operator (#25857): @pankajastro
• Add common-sql lower bound for common-sql (#25789): @potiuk
• Allow AWS Secrets Backends use AWS Connection capabilities (#25628): @Taragolis
• Implement EmrEksCreateClusterOperator (#25816): @phanikumv
• Improve error handling/messaging around bucket exist check (#25805): @o-nikolas
• Fix display aws connection info (#26025): @Taragolis
• Fix EcsBaseOperator and EcsBaseSensor arguments (#25989): @Taragolis
• Fix RDS system test (#25839): @vincbeck
• Avoid circular import problems when instantiating AWS SM backend (#25810): @Taragolis
• Fix construction of Connection object in version Amazon provider 5.0.0rc3 (#25716): @dwreeves

Provider common.sql: 1.2.0rc1

• Fix placeholders in TrinoHook, PrestoHook, SqliteHook (#25939): @alexandermalyga
• Better error messsage for pre-common-sql providers (#26051): @potiuk
• Fix (and test) SQLTableCheckOperator on postgresql (#25821): @ashb
• Don't use Pandas for SQLTableCheckOperator (#25822): @ashb
• Discard semicolon stripping in SQL hook (#25855): @kazanzhy

Provider postgres: 5.2.1rc1

• Bump dep on common-sql to fix issue with SQLTableCheckOperator (#26143): @ashb

Provider presto: 4.0.1rc1

• Add common-sql lower bound for common-sql (#25789): @potiuk
• Fix placeholders in TrinoHook, PrestoHook, SqliteHook (#25939): @alexandermalyga

Provider sqlite: 3.2.1rc1

• Add common-sql lower bound for common-sql (#25789): @potiuk
• Fix placeholders in TrinoHook, PrestoHook, SqliteHook (#25939): @alexandermalyga

Provider trino: 4.0.1rc1

• Add common-sql lower bound for common-sql (#25789): @potiuk
• Fix placeholders in TrinoHook, PrestoHook, SqliteHook (#25939): @alexandermalyga

The guidelines on how to test providers can be found in

Verify providers by contributors

All users involved in the PRs:
@pankajastro @potiuk @dwreeves @Taragolis @vincbeck @kazanzhy @ashb @phanikumv @o-nikolas @alexandermalyga

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[dwreeves]

My PR #25716 came about from testing for the Amazon provider package 5.0.0 and is a very simple 1 line change. (It was a PR for fixing a minor bug in 5.0.0rc3 from when I was testing that.) It does seem like it unfortunately made its way into the 5.0.0 release, hence why it's part of the 5.1.0 release cycle.

Previous issue when my testing uncovered it: #25640 (comment)

The 1 line change:

So I think you can ✔️ me as tested, since my PR was engendered from a test for 5.0.0?

[ashb]

@dwreeves thanks - the list was auto generated. Was your change in 5.0.0 of the provider do you know?

[Taragolis]

#25810 - No more circular import issue
#25989, #26014, #26025 - Work as expected

[eladkal]

@dwreeves thanks - the list was auto generated. Was your change in 5.0.0 of the provider do you know?

I dont think it was.
Amazon provider 5.0.0 was releases on 14-Aug
#25716 was merged on 15-Aug
The code with the amazon provider 5.0.0 tag doesnt have the changes in the PR:

airflow/airflow/providers/amazon/aws/secrets/secrets_manager.py

Line 200 in 5923788

login=data['user'],

[potiuk]

@ashb @dwreeves - the change is properly included in the Changelog for 5.1.0:

• fix bug construction of Connection object in version 5.0.0rc3 (#25716)

So I think what @dwreeves asks is to cick "OK" as "tested" - though it would be nice if you could test it yourselves @dwreeves :)

[potiuk]

Common.sql lower-bounds are updated for those providers.

[kazanzhy]

Checked #25855 with PostgresHook. Seems ok.

[dwreeves]

(Yeah sorry I wasn't clear with how I phrased that. "It made its way in" <-- "it" meaning the bug, not the fix for said bug.)

[phanikumv]

Tested #25816 , it is working good.

[potiuk]

Tested #25816 , it is working good.

What an interesting set of colours. I wonder if they mean something :)

[pankajastro]

Worked as expected #25857 and #25975

[alexandermalyga]

Tested #25939 with Trino, Presto and SQLite hooks. The issue has been solved and it works like expected.

[ashb]

Releasing now.