Skip to content
Prev 75012 / 398502 Next

How to set the floating point precision beyond e-22?

Roy Nitze wrote:
Less than that.  It depends a bit on the platform and the exact 
calculation, but you can't count on more than 15-16 decimal digits 
precision.
No.  R generally uses the floating point hardware type "double 
precision", and it's a fixed size.

The problem occurs especially when trying to
You will have to find a different solution to the problem.  To machine 
precision, that matrix looks singular.  This usually indicates that it's 
not the right matrix to try to invert.

Duncan Murdoch