Beefy Boxes and Bandwidth Generously Provided by pair Networks
Keep It Simple, Stupid

Re^2: LWP::UserAgent & memory problems

by Uree (Acolyte)
on Oct 24, 2012 at 09:22 UTC ( #1000583=note: print w/replies, xml ) Need Help??

in reply to Re: LWP::UserAgent & memory problems
in thread LWP::UserAgent & memory problems

Oh, I probably should have mentioned that the files are later being parsed with XML::LibXML, using an hybrid pull parser - dom tree strategy.
More Concretely, with XML::LibXML::Reader I implemented a pull parser and then, for every node (these type of nodes are dramatically littler than the whole XML dom tree) I load it into memory and get the data Im interested on with XML::LibXML::XPathContext.

I apologize if omitting this turned out to be misleading.
But, fact is the part of the code in charge of the parsing does work well and according to what I expect in terms of mem usage.

Now, the part that indeed doesnt work as expect is the concrete piece of code of the original post (which I isolated into this single script, for testing purposes)
The only omitted code there is an array containing the paths to the dl'd files which is being returned by the function and, also, a few more urls @ the urls array.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1000583]
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (5)
As of 2018-01-23 20:24 GMT
Find Nodes?
    Voting Booth?
    How did you see in the new year?

    Results (254 votes). Check out past polls.