We closed this forum 18 June 2010. It has served us well since 2005 as the ALPHA forum did before it from 2002 to 2005. New discussions are ongoing at the new URL http://forum.processing.org. You'll need to sign up and get a new user account. We're sorry about that inconvenience, but we think it's better in the long run. The content on this forum will remain online.
IndexProgramming Questions & HelpPrograms › Number of decimal places
Page Index Toggle Pages: 1
Number of decimal places (Read 661 times)
Number of decimal places
May 24th, 2008, 11:18pm
 
How many decimal places can processing handle in a single float or double? Is there a way to increase the depth?
Re: Number of decimal places
Reply #1 - May 24th, 2008, 11:22pm
 
floats and doubles don't have a fixed number of decimal places they can represent, they just have a set limited accuracy.
See http://www.particle.kth.se/~lindsey/JavaCourse/Book/Part1/Tech/Chapter02/floatingPt.html for some details.
Page Index Toggle Pages: 1