Skip to content

Add workflows helper functions for sparse data #1397

Closed
@EmilHvitfeldt

Description

@EmilHvitfeldt

What we need is a set of functions that that can help determine whether a recipe with sparse supporting steps should handle them as sparse or dense.

First we need a function that can toggle sparse argument. for a given step, the function should set all sparse arguments that are set to "auto" and respects if they are already set to "yes" or "no".

secondly, and harder, is a function that estimates the amount of sparsity that is produces from a recipe. For now it will be fairly simple since we don't have input-output information. It should further rely on early exits for maximal performance. e.i. if the recipe doesn't contain sparse steps -> early return.

Metadata

Metadata

Assignees

No one assigned

    Labels

    featurea feature request or enhancement

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions