-
Notifications
You must be signed in to change notification settings - Fork 16.4k
Description
Apache Airflow Provider(s)
airbyte
Versions of Apache Airflow Providers
airbyte provider version == 5.0.0
Apache Airflow version
2.10.5
Operating System
linux-arm64
Deployment
Official Apache Airflow Helm Chart
Deployment details
We're using the official helm chart with the Airflow 2.10.5 image in an EKS 1.31.0 environment (arm based) with the Airbyte operator version 5.0.0 installed.
Airbyte OSS is also deployed on the same cluster with auto disabled.
What happened
When trying to access Airbyte using the Airbyte sync operator using the default connection set as follows:
airbyte://http://<svc name>.<namespace>.svc.cluster.local/api/public/ (by following this manual) we get error 415 (unsupported media type), which basically means there is an issue with the headers being set to Airbyte.
The Airbyte connection requires a client key and secret, as stated in the manual I attached above, but Airflow is set to no auth. Could this be the issue?
What you think should happen instead
The Airbyte operator should send the right headers and sync the connector successfully.
How to reproduce
-
Install the official helm chart with the Airflow
2.10.5image in anEKS 1.31.0environment (arm based) with the Airbyte operator version5.0.0installed. -
Deploy Airbyte OSS version
1.2.0and set it to "no auth" -
Create a basic connector of any kind in Airbyte and copy its ID.
-
Create a default connection for Airbyte in the airflow environment by setting the appropriate env var.
-
Write a sync dag for Airbyte.
-
Trigger the dag and watch the results.
Anything else
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct