Skip to content

Fix precision calculation. round -> ceil#6

Open
walkerning wants to merge 1 commit intovinsci:masterfrom
walkerning:master
Open

Fix precision calculation. round -> ceil#6
walkerning wants to merge 1 commit intovinsci:masterfrom
walkerning:master

Conversation

@walkerning
Copy link

I think the calculation of number precision digits should be ceil rather than round.

Eg. I'm handling many geohased locations in Beijing, China, such as 'wx4fgur'. The calculated decimal place is at 2. However, it's obvious that we need the decimal place at 3 for a geohased location of length 7.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant