Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses

Re^5: Reducing the memory usage of Spreadsheet::ParseExcel

by runrig (Abbot)
on Jan 30, 2013 at 17:50 UTC ( #1016128=note: print w/replies, xml ) Need Help??

in reply to Re^4: Reducing the memory usage of Spreadsheet::ParseExcel
in thread Reducing the memory usage of Spreadsheet::ParseExcel

... it uses 1.0GB memory after parsing an xls-file with a single worksheet and 64772 rows and 120 columns.

Yes, the claim of "no memory overhead" is a bit of a mistake/exaggeration. But you would get the same result using just Spreadsheet::ParseExcel with the CellHandler and NotSetCell options (which S::PE correctly says "reduces" memory overhead, not has "no" memory overhead). Spreadsheet::ParseExcel parses and saves a bunch of stuff before it even gets to the cell data. So the S::PE with the CellHandler/NotSetCells options and/or S::PE::Stream only save you from storing the cell data in memory. I don't know if it would be possible to tell S::PE to not save the metadata before the cell data (or possible to modify it to implement such a thing). Only jmcnamara would know for sure..

  • Comment on Re^5: Reducing the memory usage of Spreadsheet::ParseExcel

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1016128]
LanX 1 ..2 ..3 ..4 .. is erix missing ;-)
LanX is Discipulus reciting "Springtime for Hitler" ?
[choroba]: erix could tell you how to do it in Postgres
[chacham]: wow, mysql really is as bad as i thougt
[choroba]: completion?
[LanX]: That's what he usually does when MySQL is mentioned ;-)
[chacham]: the same thing could be achieved with a trigger
[LanX]: choroba yes
chacham shudders at the thought of using a evil

How do I use this? | Other CB clients
Other Users?
Others perusing the Monastery: (11)
As of 2017-03-30 15:10 GMT
Find Nodes?
    Voting Booth?
    Should Pluto Get Its Planethood Back?

    Results (360 votes). Check out past polls.