Re^4: Processing ~1 Trillion records

[aossama]

in reply to Re^3: Processing ~1 Trillion records
in thread Processing ~1 Trillion records

Is this like using Redis to store/retrieve the key-value?

[Jenda]

Yes. You can use Redis itself, seems it does have a Perl binding. The whole point is to make sure the process fits in memory and the data that had to be moved to the disk is accessed/updated efficiently.