Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

rolling functions and merge asof? #202

Open
randomgambit opened this issue Nov 14, 2023 · 3 comments
Open

rolling functions and merge asof? #202

randomgambit opened this issue Nov 14, 2023 · 3 comments
Labels
api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. priority: p2 Moderately-important priority. Fix may not be included in next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.

Comments

@randomgambit
Copy link

Hello there and thanks for this great package!

I wonder if you plan to implement all the pandas-related rolling functions as well as the merge_asof merge. These are very powerful data manipulation tools. They are available in the spark pandas API, so I wonder if these will be available in bigquery pandas as well.

What do you think?
Thanks!
@product-auto-label product-auto-label bot added the api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. label Nov 14, 2023
@TrevorBergeron
Copy link
Contributor

Hi,
Thanks for the feature request. We do have support for rolling windows on dataframes and series, see DataFrame.rolling docs. The available aggregations are here: Window docs. Is this sufficient to cover your use case?

As for pandas.merge_asof, this is not yet implemented. I will update this issue when we add this feature.

@tswast tswast added type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design. priority: p2 Moderately-important priority. Fix may not be included in next release. labels Nov 17, 2023
@randomgambit
Copy link
Author

Thanks @tswast , just to clarify: under the hood what is the package doing exactly? are you translating the pandas methods into corresponding bigquery SQL queries? Or are you doing something else?

Thanks!

@tswast
Copy link
Collaborator

tswast commented Dec 5, 2023

@randomgambit Yes, we translate to SQL via Ibis.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
api: bigquery Issues related to the googleapis/python-bigquery-dataframes API. priority: p2 Moderately-important priority. Fix may not be included in next release. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@tswast @randomgambit @TrevorBergeron