Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight
 
PerlMonks  

Re: Math 101 anyone?

by Crian (Chaplain)
on Oct 12, 2004 at 07:46 UTC ( #398404=note: print w/replies, xml ) Need Help??


in reply to Math 101 anyone?

The Problem lies in the fact, that numbers on computers are in binary format. 1/10 is a binary number that can not be displayed (or stored) exactly in a storage with finite memory.

If you try to add binary fractions you will never end: 1/16 + 1/32 + ...

Sorry if I miss the right english words for that, I'm not a native speaker...

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://398404]
help
Chatterbox?
NodeReaper cleans and fillets

How do I use this? | Other CB clients
Other Users?
Others scrutinizing the Monastery: (5)
As of 2017-01-21 00:42 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Do you watch meteor showers?




    Results (180 votes). Check out past polls.