note dhoss <p>I've found great success using good ol' [metacpan://Text::CSV_XS] and reading in say, 10k lines at a time.</p> <p><b>UPDATE: </b> I can attest to the speed as I've been dealing with moving several terabytes of image data off of or around on AWS S3, which usually involves dumping an enormous number (40 million) of rows of csv data and having to run through it one way or another.</p> <!-- Node text goes above. Div tags should contain sig only --> <div class="pmsig"><div class="pmsig-203787"> <p>Three thousand years of beautiful tradition, from Moses to Sandy Koufax, <b>you're god damn right I'm living in the fucking past</b></p> </div></div> 1014517 1014517