Skip to content

GCSToBigQueryOperator add columnNameCharacterMap to src_fmt_configs #49314

@perttus

Description

@perttus

Description

Please add columnNameCharacterMap as valid option to src_fmt_configsparameter for GCSToBigQueryOperator for CSV file format. This could be easily achieved just by editing the src_fmt_to_configs_mapping constants.

Use case/motivation

It already works with SQL but not with the operator.

LOAD DATA OVERWRITE `xxx`
FROM FILES (
    format = 'CSV',
    skip_leading_rows=1,
    column_name_character_map = 'V2',
    uris = [
      'gs://bucket/file.csv'
    ]
);

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    kind:featureFeature Requestsneeds-triagelabel for new issues that we didn't triage yetprovider:googleGoogle (including GCP) related issues

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions