Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight

Re^2: LWP::UserAgent & memory problems

by Uree (Acolyte)
on Oct 24, 2012 at 09:22 UTC ( #1000583=note: print w/ replies, xml ) Need Help??

in reply to Re: LWP::UserAgent & memory problems
in thread LWP::UserAgent & memory problems

Oh, I probably should have mentioned that the files are later being parsed with XML::LibXML, using an hybrid pull parser - dom tree strategy.
More Concretely, with XML::LibXML::Reader I implemented a pull parser and then, for every node (these type of nodes are dramatically littler than the whole XML dom tree) I load it into memory and get the data Im interested on with XML::LibXML::XPathContext.

I apologize if omitting this turned out to be misleading.
But, fact is the part of the code in charge of the parsing does work well and according to what I expect in terms of mem usage.

Now, the part that indeed doesnt work as expect is the concrete piece of code of the original post (which I isolated into this single script, for testing purposes)
The only omitted code there is an array containing the paths to the dl'd files which is being returned by the function and, also, a few more urls @ the urls array.

Comment on Re^2: LWP::UserAgent & memory problems

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1000583]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others about the Monastery: (7)
As of 2016-04-28 23:56 GMT
Find Nodes?
    Voting Booth?
    :nehw tseb si esrever ni gnitirW

    Results (437 votes). Check out past polls.