Beefy Boxes and Bandwidth Generously Provided by pair Networks
We don't bite newbies here... much
 
PerlMonks  

Re: OT: How much float precision needed for operation?

by Enlil (Parson)
on Sep 02, 2005 at 19:11 UTC ( #488743=note: print w/ replies, xml ) Need Help??


in reply to OT: How much float precision needed for operation?

I think the term you are going to be looking for is, significant digits.

hth

-enlil


Comment on Re: OT: How much float precision needed for operation?
Re^2: OT: How much float precision needed for operation?
by 5mi11er (Deacon) on Sep 02, 2005 at 20:45 UTC
    Yes, indeed, significant digits is certainly one of the terms I need. I couldn't for the life of me remember that term, nor the closely related 'margin of error' when I first wrote my original post... Googling with "significant digits" hasn't yet led me to how to answer the question.

    I did find this link to a pdf discussing estimation of required significant digits, and I think it very likely applicable to my question, but the paper is far enough above my head that I'm unable to use that link without further assistance.

    -Scott

    Update: Ack, I hadn't seen trammell's post below when I posted this, I'm studying it now...

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://488743]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others taking refuge in the Monastery: (6)
As of 2015-07-05 15:12 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (67 votes), past polls