Beefy Boxes and Bandwidth Generously Provided by pair Networks
Don't ask to ask, just ask
 
PerlMonks  

Re^2: Optimizing Iterating over a giant hash

by chromatic (Archbishop)
on Dec 26, 2009 at 09:23 UTC ( #814411=note: print w/ replies, xml ) Need Help??


in reply to Re: Optimizing Iterating over a giant hash
in thread Optimizing Iterating over a giant hash

you might want to set $| to a nonzero, this can alleviate the 'out of memory!'

How does that work?


Comment on Re^2: Optimizing Iterating over a giant hash
Re^3: Optimizing Iterating over a giant hash
by biohisham (Priest) on Dec 26, 2009 at 15:59 UTC
    When the program output is directed to the terminal the filehandle associated with the output will be in line-buffered mode but would be block-buffered otherwise (when the output is directed to a filehandle other than the terminal STDOUT)...Buffering can not be switched off but setting the output-autoflush variable to non-zero would make the print statement not wait for the buffer to flush rather than directly outputting to the file associated with the filehandle.

    I understand that 'out of memory!' would flash when the buffer is not autoflushed in such cases and that there's large amount of data, now, if I am mistaken or cloudy on this one (I believe I am somehow) you're welcome to go ahead and correct/clarify for I am basically from a non-IT backrgound...



    Excellence is an Endeavor of Persistence. Chance Favors a Prepared Mind.
      I understand that 'out of memory!' would flash when the buffer is not autoflushed in such cases....

      I'm not aware of any such cases. That doesn't mean that they don't exist, merely that I've never heard of any.

      Buffers tend to be something like 4k on modern Linux-style systems. I have trouble imagining a system on which saving 4k is the difference between completing a task and running out of memory, at least with Perl. (If I had to write such a program, I'd use C and forbid dynamic allocation.)

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://814411]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chanting in the Monastery: (10)
As of 2014-09-18 22:00 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (125 votes), past polls