Beefy Boxes and Bandwidth Generously Provided by pair Networks
more useful options
 
PerlMonks  

Re^3: Parallel::Forkmanager and large hash, running out of memory

by Anonymous Monk
on Apr 24, 2013 at 15:30 UTC ( #1030446=note: print w/ replies, xml ) Need Help??

Comment on Re^3: Parallel::Forkmanager and large hash, running out of memory
Re^4: Parallel::Forkmanager and large hash, running out of memory
by mabossert (Beadle) on Apr 24, 2013 at 16:42 UTC

    Got it...I guess I need to lay off the crack pipe...Thanks!

    Of course, this brings me to the next challenge: concurrency. Since I will be doing this work in parallel, I will have to see how SQLite handles concurrency...or perhaps lean over towards MySQL...

    Thanks again for the help to you (and all others that responded...)

      The relevant doc is here.

      The tl;dr: version is: any number of processes can read at the same time. When a process wants to write to the database, the engine is notified, waits for current readers to finish, then gives exclusive access to the writer process. No one can read while a write is occurring. When the write is finished, everybody can start reading again.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1030446]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others scrutinizing the Monastery: (9)
As of 2014-08-20 09:52 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The best computer themed movie is:











    Results (110 votes), past polls