Skip to content

sparse toggling mechanic #271

@EmilHvitfeldt

Description

@EmilHvitfeldt

We need a way to toggle whether sparse features should be produced or not. the general idea is fairly simple and could be done like so:

flowchart TD
    A[Does model support sparse input?]
    AA[don't make sparse data]
    B[is there high sparsity in the data?]
    BA[make sparse data]
    BB[don't make sparse data]
    A -->|Yes| B
    A -->|No| AA
    B -->|Yes| BA
    B -->|No| BB
Loading

the hard part is finding a good default threshold for is there high sparsity in the data?. We will investigate that in tidymodels/planning#34, tidymodels/planning#33.

We will likewise get helpers from {recipes} in tidymodels/recipes#1397 to aid in this decision. Determining the sparsity of a recipe should live in the recipes package. the sparsity calculator will be located in {sparsevctrs} r-lib/sparsevctrs#82

Another wrinkle is that this determination will be preprocessor dependent. non-recipes preprocessors are easier to handle.

Metadata

Metadata

Assignees

No one assigned

    Labels

    featurea feature request or enhancement

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions