Skip to content
Prev 274162 / 398506 Next

extra digits added to data

what are you going to do with the data?  If just for presentation, then keep as character.  If you are going to compute on the data, then keep as numeric.  Since you are using floating point, FAQ 7.31 reminds you that the data "is kept" as inputted to the best that can be done with 54 bits of precision.  You can always use 'round' or 'sprintf' for output if you want it to 'look' the same.  Read the paper pointed to by FAQ 7.31 for an in depth understanding of what is happening.  The other solution is to find a package tha works with decimal instead of binary; 'bc'?

Sent from my iPad
On Oct 11, 2011, at 11:57, Mark Harrison <harrisonmark1 at gmail.com> wrote: