Skip to content

NEON_FLT_SP and ALTIVEC float32x4 implementation of sqrt(0) returns NaN #133

Open
Open
NEON_FLT_SP and ALTIVEC float32x4 implementation of sqrt(0) returns NaN#133
Labels
bug

Description

@peabody-korg
peabody-korg
opened on May 30, 2019

the formula for these appears to use the 1/sqrt(a) estimate operation, which presumably results in Inf for a=0. Probably need to explicitly check for a==0 and mask result accordingly.

Activity

  1. p12tic commented on Jun 2, 2019

    @p12tic
    p12tic
    on Jun 2, 2019
    Owner

    Agreed, thanks for the report.

  2. p12tic
    added
    bug
    on Jun 2, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bug

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions