New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BigQueryIO TableRowParser should support Arrow and Avro data formats #20100

Open

damccorm opened this issue Jun 4, 2022 · 0 comments · May be fixed by #32360

Labels

gcp improvement io java P3

Contributor

damccorm commented Jun 4, 2022

We should implement a function like BigQueryIO#readRows that encapsulate row conversion logic [1] for both Arrow and Avro data formats.

BigQueryTable#buildIOReader from SQL extension should call the function described above.

[1] #10369 (comment)

Imported from Jira BEAM-9114. Original Jira may contain additional context.
Reported by: kirillkozlov.

damccorm added improvement io-java-gcp P3 labels

damccorm added gcp io java and removed io-java-gcp labels

RustedBones linked a pull request

that will close this issue

BigQueryIO uniformize direct and export reads #32360

Draft

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment