Pathologically Eclectic Rubbish Lister | |
PerlMonks |
Re: Speed up file write taking weeksby dave_the_m (Monsignor) |
on Jun 29, 2019 at 14:56 UTC ( [id://11102120]=note: print w/replies, xml ) | Need Help?? |
If we assume that writing 1.7 trillion records takes two weeks, then that's 1.4 million records per second, which is a reasonable number, assuming that the fields are of a decent size. So while you might be able to speed up things a bit, I'd be surprised if you could reduce it from weeks to days.
You'd have to paraellelise it, with multiple disks and CPUs
Dave.
In Section
Seekers of Perl Wisdom
|
|