Skip to content

GCSToBigQueryOperator no longer uses field_delimiter or time_partitioning #27842

@mdering

Description

@mdering

Apache Airflow Provider(s)

google

Versions of Apache Airflow Providers

google=8.5.0

Apache Airflow version

2.4.3

Operating System

Debian GNU/Linux 11 (bullseye)

Deployment

Other Docker-based deployment

Deployment details

No response

What happened

The newest version of the google providers no longer provides the field_delimiter or time_partitioning fields to the bq job configuration for the GCStoBQ transfers. Looking at the code it seems like this behavior was removed during the change to use deferrable operations

What you think should happen instead

These fields should continue to be provided

How to reproduce

No response

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions