Skip to content
This repository was archived by the owner on Mar 20, 2024. It is now read-only.

Rounding increment is unclear when d equals to 0 #934

@sun-jacobi

Description

@sun-jacobi

In 3.8, we have a pair of functions roundoff_unsigned and roundoff_signed

roundoff_unsigned(v, d) = (unsigned(v) >> d) + r
roundoff_signed(v, d) = (signed(v) >> d) + r

and the Rounding increment r depends on the rounding mode ( i.e vxrm)

In the table, r is given by expressions like v[d-1].
But this definition is unclear when d equals 0.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions