LWP::UserAgent & memory problemsby Uree (Acolyte)
|on Oct 23, 2012 at 16:51 UTC||Need Help??|
Uree has asked for the wisdom of the Perl Monks concerning the following question:
First of all, and this being my first post in the place, hi everyone.
Now, Im using LWP::UserAgent to download large XML files.
Files do download successfully and their content is the expected, the problem is the high memory usage due to their size (>100MB).
(Commented lines are additional ways I've tried to work the high mem usage around)
My problem is that, apparently, although I'm using the ":content_file" option, files' content DOES still get loaded into memory.
I am quite stuck with this one, so I'd appreciate Monks' almighty support.