Skip to content

Use ODE solvers/integrators to improve score matching training #1469

Open
@psteinb

Description

@psteinb

🚀 Feature Request

Is your request related to a problem?

The Score Matching Estimators do benefit from solving the ODE which they approximate by establishing an SDE during training. ODEs would help solve the continuous problem, while the SDEs remain in the discrete representation.

...

Describe the solution you'd like

We would have to research which ODE solvers we may want to interface with. A simple solution would be to convert all torch.Tensor instances into numpy.ndarrays and use scipy.odeint as scipy is already a dependency of sbi. However, this will likely not work for bigger problem sizes.

Describe alternatives you've considered

As suggested by @gmoss13, a viable library to do the ODE integration within pytorch would be torchdiffeq. But more research is required to check pros/cons of adding this or any other library as a dependency to sbi

📌 Additional Context

ODE based training for score matching estimators will support high dimensionality use cases of sbi

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions