Delete parse data spreadsheet::parseexcel

Hi Monks, sorry for my precedent wrong question....

Is possible delete parsed data (with spreadsheet::parseexcel) from ram memory?

Because my a script parses a series of Excel files, and write data I need with XML::LibXML in a xml file. The logic works fine but my problem is that I keep running out of ram memory (4gb). I'm processing the files sequentially and I'm losing a lot of memory with parsing each new file. Now I have over 30 big excel files and after parsed 5 excel file the ram memory is full and process very slow. I need delete the parsed data stored in ram memory just before start parsing the second excel file, and the same for each excel file. Or I need alternative cell handling techniques that store only one excel file at once to limit memory usage..

Thankyou very much for your help

Andrea

Comment on Delete parse data spreadsheet::parseexcel
Re: Delete parse data spreadsheet::parseexcel by Kenosis (Deacon) on Feb 05, 2013 at 18:51 UTC
Try using Spreadsheet::ParseExcel::Stream instead, as it's optimized to use significantly less memory (even though it's a front-end for Spreadsheet::ParseExcel).	[reply]
Re^2: Delete parse data spreadsheet::parseexcel by cibien (Novice) on Feb 05, 2013 at 20:03 UTC
Thanks, I try Spreadsheet::ParseExcel::Stream, but is complicated for me... http://www.perlmonks.org/?node_id=1015095	[reply]
Re^3: Delete parse data spreadsheet::parseexcel by runrig (Abbot) on Feb 06, 2013 at 00:28 UTC
but is complicated for me I don't get it...it is simpler to use...if you have trouble using something simpler, what hope is there?	[reply]
Re^4: Delete parse data spreadsheet::parseexcel by cibien (Novice) on Feb 06, 2013 at 22:57 UTC
Re: Delete parse data spreadsheet::parseexcel by moritz (Cardinal) on Feb 05, 2013 at 18:58 UTC
Once you're done parsing a file, simply stop keep a reference to the parser object. Then the memory allocated for that object is freed. Perl 6 - the future is here, just unevenly distributed	[reply]
Re^2: Delete parse data spreadsheet::parseexcel by cibien (Novice) on Feb 05, 2013 at 19:58 UTC
Sorry but I'am novice in perl.... how I do "simply stop keep a reference to the parser object" in spreadsheet::parseexcel? Thanks	[reply]
Re^3: Delete parse data spreadsheet::parseexcel by moritz (Cardinal) on Feb 05, 2013 at 20:14 UTC
That's hard to tell without seeing your code (hint, hint). Perl 6 - the future is here, just unevenly distributed	[reply]
Re^4: Delete parse data spreadsheet::parseexcel by cibien (Novice) on Feb 05, 2013 at 20:21 UTC
Re^5: Delete parse data spreadsheet::parseexcel by moritz (Cardinal) on Feb 06, 2013 at 00:05 UTC
Re^4: Delete parse data spreadsheet::parseexcel by cibien (Novice) on Feb 05, 2013 at 21:27 UTC
Re^4: Delete parse data spreadsheet::parseexcel by cibien (Novice) on Feb 06, 2013 at 22:44 UTC
Re^5: Delete parse data spreadsheet::parseexcel by moritz (Cardinal) on Feb 07, 2013 at 06:56 UTC
Some notes below your chosen depth have not been shown here
Re^4: Delete parse data spreadsheet::parseexcel by cibien (Novice) on Feb 07, 2013 at 14:50 UTC
Re^2: Delete parse data spreadsheet::parseexcel by runrig (Abbot) on Feb 06, 2013 at 00:19 UTC
simply stop keep a reference to the parser object. Then the memory allocated for that object is freed. No, not for Spreadsheet::ParseExcel objects...they contain circular references (workbooks reference worksheets and vice versa, etc.), so they don't go away until the end of your program. Best thing to do is to parse each spreadsheet in a separate process (using Parallel::ForkManager or just plain fork or just launch a separate system command or something).	[reply]
Re^3: Delete parse data spreadsheet::parseexcel by moritz (Cardinal) on Feb 06, 2013 at 00:53 UTC
they contain circular references (workbooks reference worksheets and vice versa, etc.), so they don't go away until the end of your program If that's really the case, please open a bug report. However the source does use Scalar::Util::weaken, and my very basic testing shows that the objects do get released when I set the reference to the workbook to `undef`. Perl 6 - the future is here, just unevenly distributed	[reply] [d/l]
Re^4: Delete parse data spreadsheet::parseexcel by runrig (Abbot) on Feb 06, 2013 at 16:00 UTC


Don't ask to ask, just ask
	PerlMonks

Delete parse data spreadsheet::parseexcel

How many continents have you visited?