Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses
 
PerlMonks  

Re^2: selecting columns from a tab-separated-values file

by ibm1620 (Scribe)
on Jan 22, 2013 at 04:09 UTC ( #1014563=note: print w/ replies, xml ) Need Help??


in reply to Re: selecting columns from a tab-separated-values file
in thread selecting columns from a tab-separated-values file

Yes, 10^9 records. The entire file is more like 80GB, since there are frequent empty fields. I estimated the time for my Perl program to pass the entire file to be around 5 hours. Don't know how much faster cat is, but it's GOT to be faster than that (I'm not at work at the moment).


Comment on Re^2: selecting columns from a tab-separated-values file

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1014563]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others making s'mores by the fire in the courtyard of the Monastery: (15)
As of 2015-07-31 14:58 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (278 votes), past polls