Skip to content

Numpy Issue with Bigger bit sizes #76

@DaveKirkland

Description

@DaveKirkland

Getting strange results when using larger bit sizes in numpy calls

# This works
w = Fxp([1, 1, 1, 1], dtype='fxp-s29/0')
y=np.cumsum(w)
y.info()

# This doesn't
w = Fxp([1, 1, 1, 1], dtype='fxp-s32/0')
y=np.cumsum(w)
y.info()

The first call returns [1 2 3 4], while the 2nd returns [-1 -1 -1 -1]

Version info
OS - Windows 10
Python - 3.8.5
Numpy - 1.21.2
fxpmath - 0.4.8

Metadata

Metadata

Assignees

No one assigned

    Labels

    Numpy:LargePrecisionIssue when numpy has to deal with large precisionOS:WindowsIssue when running in Windows

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions