Re: Out of memory and While replacements with excel XLSX application

[jmcnamara]

in reply to Out of memory and While replacements with excel XLSX application

The "out of memory" issue is probably caused by Excel::Writer::XLSX. Especially if you have 1 million rows.

You can reduce its memory usage (almost completely*) by setting the workbook set_optimization() method.

    ...
    my $workbook = Excel::Writer::XLSX->new( file.xlsx' );
    $workbook->set_optimization();

    my $worksheet = $workbook->add_worksheet();
    ...

* See the Speed and Memory Usage section of the Excel::Writer::XLSX docs for a full explanation.

--
John.

[Weinstar]

This answer was the first one I succefully implemeted. It was a solution to the original question of how to avoid a "out of memory" return, while still writing to .XLSX files. Thanks to the poster.

The total system memory use never exceeded 4GB as before and the total runtime seemed unchanged.

I will test some the other solutions to see if the runtime can be optimized through better coding on my part.