Beefy Boxes and Bandwidth Generously Provided by pair Networks
more useful options
 
PerlMonks  

Re^6: Reading (the same) data in different ways & memory usage

by Neighbour (Friar)
on Apr 21, 2011 at 08:26 UTC ( [id://900504]=note: print w/replies, xml ) Need Help??


in reply to Re^5: Reading (the same) data in different ways & memory usage
in thread Reading (the same) data in different ways & memory usage

I would expect this to be the case for Fixed-Point values (DECIMAL and NUMERIC types), but not for FLOAT and DOUBLE, which already suffer from floating point representation errors because, well, that's what they are (even inside MySQL).
  • Comment on Re^6: Reading (the same) data in different ways & memory usage

Replies are listed 'Best First'.
Re^7: Reading (the same) data in different ways & memory usage
by BrowserUk (Patriarch) on Apr 21, 2011 at 09:13 UTC

    They may be stored on disk as IEEE floats (or some other binary representation), but if they are defined as FLOAT(7,2), then the DB needs to return them to you in that form. Ie. with no more than 2 decimal places.

    But if the value arises due to math internal to the DB, then the binary representation may contain more than two decimal places. just as when you do math in perl. Eg.

    $n = 1/10;; printf "%.17f\n", $n;; 0.10000000000000001

    So, when it returns a value it needs to round or truncate to meet the column type, and the easiest way to do that is sprintf which returns a string.


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://900504]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others surveying the Monastery: (4)
As of 2026-04-14 03:24 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found

    Notices?
    hippoepoptai's answer Re: how do I set a cookie and redirect was blessed by hippo!
    erzuuliAnonymous Monks are no longer allowed to use Super Search, due to an excessive use of this resource by robots.