Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re^4: Processing ~1 Trillion records

by aossama (Acolyte)
on Oct 25, 2012 at 12:36 UTC ( #1000852=note: print w/replies, xml ) Need Help??


in reply to Re^3: Processing ~1 Trillion records
in thread Processing ~1 Trillion records

Is this like using Redis to store/retrieve the key-value?

Replies are listed 'Best First'.
Re^5: Processing ~1 Trillion records
by Jenda (Abbot) on Oct 25, 2012 at 13:37 UTC

    Yes. You can use Redis itself, seems it does have a Perl binding. The whole point is to make sure the process fits in memory and the data that had to be moved to the disk is accessed/updated efficiently.

    Jenda
    Enoch was right!
    Enjoy the last years of Rome.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1000852]
help
Chatterbox?
[stevieb]: I have learned that my daughter has significant brain injury, so that's affecting my decisions. Don't know who to reach out to. I just want to vent. I am honestly lost. It's something I can't code around.
[stevieb]: I am infuriated at the same time I am hopeless. It appears there are approaches to 'fix' things, but, you know..,

How do I use this? | Other CB clients
Other Users?
Others taking refuge in the Monastery: (5)
As of 2017-02-25 04:03 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Before electricity was invented, what was the Electric Eel called?






    Results (365 votes). Check out past polls.