Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses
 
PerlMonks  

Re: Out of memory and While replacements with excel XLSX application

by jmcnamara (Monsignor)
on Oct 08, 2012 at 10:02 UTC ( #997794=note: print w/ replies, xml ) Need Help??


in reply to Out of memory and While replacements with excel XLSX application

The "out of memory" issue is probably caused by Excel::Writer::XLSX. Especially if you have 1 million rows.

You can reduce its memory usage (almost completely*) by setting the workbook set_optimization() method.

... my $workbook = Excel::Writer::XLSX->new( file.xlsx' ); $workbook->set_optimization(); my $worksheet = $workbook->add_worksheet(); ...

* See the Speed and Memory Usage section of the Excel::Writer::XLSX docs for a full explanation.

--
John.


Comment on Re: Out of memory and While replacements with excel XLSX application
Download Code
Re^2: Out of memory and While replacements with excel XLSX application
by Weinstar (Initiate) on Oct 09, 2012 at 05:09 UTC

    This answer was the first one I succefully implemeted. It was a solution to the original question of how to avoid a "out of memory" return, while still writing to .XLSX files. Thanks to the poster.

    The total system memory use never exceeded 4GB as before and the total runtime seemed unchanged.

    I will test some the other solutions to see if the runtime can be optimized through better coding on my part.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://997794]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (12)
As of 2015-07-01 21:18 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (22 votes), past polls