Status of testing Providers that were prepared on February 18, 2023

[eladkal]

Body

I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?

Let us know in the comment, whether the issue is addressed.

Those are providers that require testing as there were some substantial changes introduced:

Provider amazon: 7.2.1rc1

• Explicitly handle exceptions raised by config parsing in AWS provider (#29587): @potiuk
• Fix docstring for EcsRunTaskOperator region_name -> region (#29562): No testing required

Provider apache.beam: 4.3.0rc1

• Get rid of state in Apache Beam provider hook (#29503): @dannikay

Provider apache.hive: 5.1.3rc1

• Validate Hive Beeline parameters (#29502): @potiuk

Provider apache.sqoop: 3.1.1rc1

• Move libjars parameter in Sqoop Hook to Hook parameter (#29500): @potiuk

Provider cncf.kubernetes: 5.2.1rc1

• Fix @task.kubernetes to receive input and send output (#28942): @vchiapaikeo

Provider docker: 3.5.1rc1

• fix template_fields in the decorator task.docker (#29586): @jeffery9876

Provider google: 8.10.0rc1

• Add defer mode to GKECreateClusterOperator and GKEDeleteClusterOperator (#28406): @MrGeorgeOwl
• Move cloud_sql_binary_path from connection to Hook (#29499): @potiuk
• Check that cloud sql provider version is valid (#29497): @potiuk
• GoogleDriveHook: Add folder_id param to upload_file (#29477): @shahar1
  Linked issues:
  • Google provider doesn't let uploading file to a shared drive (#29552) @aru-trackunit
• Add documentation for BigQuery transfer operators (#29466): @shahar1

Provider http: 4.2.0rc1

• Add HttpHookAsync for deferrable implementation (#29038): @sunank200

Provider microsoft.azure: 5.2.1rc1

• Handle deleting more than 256 blobs using WasbHook.delete_file() (#29565): @josh-fell

Provider sftp: 4.2.3rc1

• Fix sftp sensor with pattern (#29467): @BenediktRamsauer

Provider snowflake: 4.0.4rc1

• Fix SQL syntax for files parameter in CopyFromExternalStageToSnowflakeOperator (#29437): @bnix

The guidelines on how to test providers can be found in

Verify providers by contributors

All users involved in the PRs:
@potiuk @vchiapaikeo @bnix @shahar1 @jeffery9876 @BenediktRamsauer @MrGeorgeOwl @deanmorin @josh-fell @dannikay @sunank200

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[eladkal]

Contributors are also encouraged to cast vote in the mailing list thread.

[potiuk]

Checked: #29587, #29502, #29500, #29499 , #29497. All are good.

[josh-fell]

#29565 looks good.

Thanks for organizing @eladkal!

[aru-trackunit]

#29552 Tested and it works.
From my perspective there are 2 issues.

• proper documentation on how to use drive_folder and folder_id arguments together (as they can be confusing)
• log doesn't print the exact path where the file will be located. (I believe log shouldn't print the path, or print it correctly, is it worth making X amount of calls and go up the folder tree, since google returns only parent directory.

I am happy to address (in this or next release) them just let me know your thoughts

[eladkal]

#29552 Tested and it works. From my perspective there are 2 issues.

• proper documentation on how to use drive_folder and folder_id arguments together (as they can be confusing)
• log doesn't print the exact path where the file will be located. (I believe log shouldn't print the path, or print it correctly, is it worth making X amount of calls and go up the folder tree, since google returns only parent directory.

I am happy to address (in this or next release) them just let me know your thoughts

Feel free to raise PR to adress this since these are not regressions it will not block this release.

[vchiapaikeo]

#28942 still looks good.

Thanks Elad!

[eladkal]

Thank you everyone.
Providers are released
I invite everyone to help improve providers for the next release, a list of open issues can be found here.

[BenediktRamsauer]

I'm a bit late to the party, but #29467 is tested on sftp: 4.2.4 and is working.

Thank you for the work.