Add support for Server Side Cursors (a.k.a. stream results) #407
Labels
api: bigquery
Issues related to the googleapis/python-bigquery-sqlalchemy API.
type: feature request
‘Nice-to-have’ improvement, new feature or different behavior or design.
Is your feature request related to a problem? Please describe.
Please support the sqlalchemy stream_results cursor feature to break up large queries that would overwhelm a systems memory.
Describe the solution you'd like
An implementation similar to this post: https://pythonspeed.com/articles/pandas-sql-chunking/
Describe alternatives you've considered
Currently I have to perform an upload after every SELECT DISTINCT query I do to make sure my next query "chunk" will not grab the same row elements.
Related Issue in Pandas: pandas-dev/pandas#35689
The text was updated successfully, but these errors were encountered: