Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things

Re^4: Processing ~1 Trillion records

by aossama (Acolyte)
on Oct 25, 2012 at 12:36 UTC ( #1000852=note: print w/replies, xml ) Need Help??

in reply to Re^3: Processing ~1 Trillion records
in thread Processing ~1 Trillion records

Is this like using Redis to store/retrieve the key-value?

Replies are listed 'Best First'.
Re^5: Processing ~1 Trillion records
by Jenda (Abbot) on Oct 25, 2012 at 13:37 UTC

    Yes. You can use Redis itself, seems it does have a Perl binding. The whole point is to make sure the process fits in memory and the data that had to be moved to the disk is accessed/updated efficiently.

    Enoch was right!
    Enjoy the last years of Rome.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1000852]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others rifling through the Monastery: (8)
As of 2016-10-25 12:12 GMT
Find Nodes?
    Voting Booth?
    How many different varieties (color, size, etc) of socks do you have in your sock drawer?

    Results (317 votes). Check out past polls.