Status of testing Providers that were prepared on December 28, 2023

[potiuk]

Body

I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?

The guidelines on how to test providers can be found in

Verify providers by contributors

Let us know in the comment, whether the issue is addressed.

Those are providers that require testing as there were some substantial changes introduced:

Provider alibaba: 2.7.1rc1

• Clean OSS task handler code after bumping min Airflow version to 2.6.0 (#36420): @hussein-awala

Provider amazon: 8.15.0rc1

• Add Amazon Athena query results extra link (#36447): @Taragolis
• remove event['message'] call in EmrContainerOperator.execute_complete|as the key message no longer exists (#36417): @Lee-W
• handle tzinfo in S3Hook.is_keys_unchanged_async (#36363): @Lee-W
• Use base aws classes in Amazon ECS Operators/Sensors/Triggers (#36393): @jayceslesar

Provider apache.hdfs: 4.3.2rc1

• Remove _read method from hdfs task handler after bumping min airflow version to 2.6 (#36425): @hussein-awala
• Consolidate loading delete_local_logs conf in hdfs task handler (#36422): @hussein-awala

Provider apache.kylin: 3.5.0rc1

• Add apache kylin conn type and kylin connection docs (#36413): @shohamy7

Provider cncf.kubernetes: 7.13.0rc1

• Allow changing of config_file in KubernetesResourceBaseOperator (#36397): @romsharon98
• Add reminder about update stub file in case of change KubernetesPodOperator's arguments (#36434): @Taragolis
• Fix AirflowSkipException message raised by KubernetesPodOperator (#36355): @dolfinus
• Remove deprecated input parameters in the k8s pod operator (#36433): @dirrao
• Delete get_python_source from Kubernetes decorator after bumping min airflow version to 2.6.0 (#36426): @hussein-awala
• Remove duplicated methods in K8S pod operator module and import them from helper function (#36427): @hussein-awala

Provider elasticsearch: 5.3.1rc1

• Remove getattr in es task handler when airflow min version bumped to 2.6 (#36431): @dirrao

Provider google: 10.13.1rc1

• Remove backcompat code for stackdriver (#36442): @potiuk
• Remove unused _parse_version function (#36450): @Taragolis
• Remove remaining Airflow 2.5 backcompat code from GCS Task Handler (#36457): @potiuk

Provider microsoft.azure: 8.5.1rc1

• Remove unused _parse_version function (#36450): @Taragolis
• Clean WASB task handler code after bumping min Airflow version to 2.6.0 (#36421): @hussein-awala

Provider weaviate: 1.3.0rc1

• Add WeaviateDocumentIngestOperator (#36402): @utkarsharma2
• Add 'uuid_column', 'tenant' params to WeaviateIngestOperator (#36387): @utkarsharma2
• Add create_or_replace_document_objects method to weaviate provider (#36177): @utkarsharma2
• Remove 'insertion_errors' as required argument for weaviate's hook 'batch_data' method (#36435): @utkarsharma2

Provider zendesk: 4.6.0rc1

• Add docs about zendesk connection and creating dedicated connection form (#36423): @shohamy7

All users involved in the PRs:
@romsharon98 @jayceslesar @dolfinus @Lee-W @utkarsharma2 @potiuk @shohamy7 @Taragolis @hussein-awala @dirrao

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[Taragolis]

Check my changes:

• Add Amazon Athena query results extra link #36447 : Works as expected
• Add reminder about update stub file in case of change KubernetesPodOperator's arguments #36434 : Internal changes: comments added
• Remove unused _parse_version function #36450: Internal changes: no side effects found

[Lee-W]

Tested our example DAGs with the following providers without encountering issues

• apache-airflow-providers-amazon==8.15.0rc1
• apache-airflow-providers-cncf-kubernetes==7.13.0rc1
• apache-airflow-providers-google==10.13.1rc1
• apache-airflow-providers-microsoft-azure==8.5.1rc1

[Lee-W]

#36417 and #36363 also verified

[dirrao]

I have verified #36433 and #36431. They look good to me.

[shohamy7]

Verified #36423 and #36413, looks good

[hussein-awala]

I checked my changes, and all looks good!

[potiuk]

Thank you everyone. Providers are released (except Waeviate that will have ad-hoc release shortly).

I invite everyone to help improve providers for the next release, a list of open issues can be found here.