Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

Re^5: Text CSV_XS memory crash

by marto (Cardinal)
on Feb 02, 2011 at 16:01 UTC ( [id://885775]=note: print w/replies, xml ) Need Help??


in reply to Re^4: Text CSV_XS memory crash
in thread Text CSV_XS memory crash

Have you considered using DBD::CSV, or alternativly importing your data into a database of some sort?

Replies are listed 'Best First'.
Re^6: Text CSV_XS memory crash
by Tux (Canon) on Feb 02, 2011 at 18:18 UTC

    Using DBD::CSV will never be a valid option when reading a CSV file in full will cause memory hogs, as DBD::CSV will read the whole file into memory always. Nothing to prevent that. That means that the memory consumption for CSV files accessed with DBI might be up to double the size of the complete dataset as returned bi Text::CSV_XS->getline_all ().


    Enjoy, Have FUN! H.Merijn

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://885775]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others browsing the Monastery: (5)
As of 2025-03-17 08:27 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    When you first encountered Perl, which feature amazed you the most?










    Results (54 votes). Check out past polls.