Beefy Boxes and Bandwidth Generously Provided by pair Networks
Don't ask to ask, just ask
 
PerlMonks  

Re^4: Processing ~1 Trillion records

by aossama (Acolyte)
on Oct 25, 2012 at 12:36 UTC ( #1000852=note: print w/ replies, xml ) Need Help??


in reply to Re^3: Processing ~1 Trillion records
in thread Processing ~1 Trillion records

Is this like using Redis to store/retrieve the key-value?


Comment on Re^4: Processing ~1 Trillion records
Re^5: Processing ~1 Trillion records
by Jenda (Abbot) on Oct 25, 2012 at 13:37 UTC

    Yes. You can use Redis itself, seems it does have a Perl binding. The whole point is to make sure the process fits in memory and the data that had to be moved to the disk is accessed/updated efficiently.

    Jenda
    Enoch was right!
    Enjoy the last years of Rome.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1000852]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others having an uproarious good time at the Monastery: (4)
As of 2014-07-12 11:58 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    When choosing user names for websites, I prefer to use:








    Results (239 votes), past polls