Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot
 
PerlMonks  

Re^2: selecting columns from a tab-separated-values file

by ibm1620 (Scribe)
on Jan 22, 2013 at 04:09 UTC ( #1014563=note: print w/replies, xml ) Need Help??


in reply to Re: selecting columns from a tab-separated-values file
in thread selecting columns from a tab-separated-values file

Yes, 10^9 records. The entire file is more like 80GB, since there are frequent empty fields. I estimated the time for my Perl program to pass the entire file to be around 5 hours. Don't know how much faster cat is, but it's GOT to be faster than that (I'm not at work at the moment).
  • Comment on Re^2: selecting columns from a tab-separated-values file

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1014563]
help
Chatterbox?
[erix]: looks like a fork, rather, no?
LanX /me /me
[erix]: /hehehe
[marto]: LanX yesterday I found out about Gish gallop tactic
[marto]: "Eugenie Scott, executive director of the National Center for Science Education, dubbed this approach the Gish gallop, describing it as "where the creationist is allowed to run on for 45 minutes or an hour, spewing forth torrents of error that the
[marto]: evolutionist hasn't a prayer of refuting in the format of a debate." She also criticized Gish for failing to answer objections raised by his opponents"
[erix]: one would hope evolutionists haven't any prayers anyway

How do I use this? | Other CB clients
Other Users?
Others browsing the Monastery: (9)
As of 2017-07-28 15:40 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    I came, I saw, I ...
























    Results (431 votes). Check out past polls.