Beefy Boxes and Bandwidth Generously Provided by pair Networks
more useful options
 
PerlMonks  

Re: selecting columns from a tab-separated-values file

by stonecolddevin (Vicar)
on Jan 23, 2013 at 18:08 UTC ( #1014974=note: print w/ replies, xml ) Need Help??


in reply to selecting columns from a tab-separated-values file

I've found great success using good ol' Text::CSV_XS and reading in say, 10k lines at a time.

UPDATE: I can attest to the speed as I've been dealing with moving several terabytes of image data off of or around on AWS S3, which usually involves dumping an enormous number (40 million) of rows of csv data and having to run through it one way or another.

Three thousand years of beautiful tradition, from Moses to Sandy Koufax, you're god damn right I'm living in the fucking past


Comment on Re: selecting columns from a tab-separated-values file

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1014974]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others studying the Monastery: (6)
As of 2014-07-24 04:19 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite superfluous repetitious redundant duplicative phrase is:









    Results (157 votes), past polls