Skip to content

[FEA] Polars engine CPU fallback for GPU out-of-memory errors #16835

Open

Description

Today, users of the Polars GPU engine don't experience graceful performance degradation for GPU out-of-memory errors like users of cuDF pandas do -- instead, the query will fail. This is a pain point that's come up consistently in feedback from early users.

In parallel to investigating UVM, we should also investigate the feasibility of the current inspector-executor design supporting different types of CPU fallback when the GPU engine hits an out-of-memory error. E.g., we could rewind and execute the full query from scratch with the CPU engine or we could rewind only a portion of the query (which might require subgraph based hybrid execution).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    PythonAffects Python cuDF API.cudf.polarsIssues specific to cudf.polarsfeature requestNew feature or request

    Type

    No type

    Projects

    • Status

      Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions