-
Notifications
You must be signed in to change notification settings - Fork 323
Open
Labels
api: bigqueryIssues related to the googleapis/python-bigquery API.Issues related to the googleapis/python-bigquery API.
Description
Is your feature request related to a problem? Please describe.
The polars community uses the arrow in-memory format without a need for a dependency on the heavy weight pyarrow package, but the easiest way to get arrow out of and into BigQuery with this client requires the use of the pyarrow dependency.
Describe the solution you'd like
Expose the Arrow PyCapsule Interface on RowIterator (returned by QueryJob.result(), Client.query_and_wait(), Client.list_rows()). This functionality should not require pyarrow. See: https://gist.github.com/tswast/99b017b20386e324f5c7d2bd49f21b5f for a related example of how this could be done.
Describe alternatives you've considered
- Separate package exposing the Arrow PyCapsule Interface
- Always require pyarrow
- Directly integrate into polars (in-progress)
Additional context
henryharbeck and alexander-beedie
Metadata
Metadata
Assignees
Labels
api: bigqueryIssues related to the googleapis/python-bigquery API.Issues related to the googleapis/python-bigquery API.