Beefy Boxes and Bandwidth Generously Provided by pair Networks
"be consistent"
 
PerlMonks  

Re: HTML::TableExtract Memory Usage

by Anonymous Monk
on Sep 04, 2010 at 14:30 UTC ( [id://858878]=note: print w/replies, xml ) Need Help??


in reply to HTML::TableExtract Memory Usage

This leaks practically nothing
#!/usr/bin/perl -- use strict; use warnings; use WWW::Mechanize; use HTML::TableExtract qw(tree); start(); exit(); sub start { my $agent = WWW::Mechanize->new( stack_depth => 0 ); $agent->agent_alias('Windows IE 6'); $agent->get('http://www.perlmonks.org/'); my $page = $agent->content; for ( my $c = 0 ; $c < 500 ; $c++ ) { my $te = HTML::TableExtract->new(); $te->parse($page); $te->eof; print "$te c is $c\n"; eval { $te->delete; }; ## leaks memory without this call as exp +ected undef $te; select undef, undef, undef, 0.1; } ## end for ( my $c = 0 ; $c < ...) } ## end sub start BEGIN { sub HTML::TableExtract::DESTROY { my ($self) = @_; for my $key ( keys %$self ) { eval { $self->{$key}->delete; }; eval { $self->{$key}->detach; }; delete $self->{$key}; } return; } ## end sub HTML::TableExtract::DESTROY *HTML::ElementTable::DESTROY = \&HTML::TableExtract::DESTROY; *HTML::ElementGlob::DESTROY = \&HTML::TableExtract::DESTROY; *HTML::TableExtract::Table::DESTROY = \&HTML::TableExtract::DESTROY; } ## end BEGIN
on my machine it starts at 17mb/14mb VM, and by the 500th iteration its at 18mb/16mb.

My guess is this very tiny leak is probably in HTML::Parser.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://858878]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others pondering the Monastery: (4)
As of 2026-01-16 12:53 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    What's your view on AI coding assistants?





    Results (118 votes). Check out past polls.

    Notices?
    hippoepoptai's answer Re: how do I set a cookie and redirect was blessed by hippo!
    erzuuliAnonymous Monks are no longer allowed to use Super Search, due to an excessive use of this resource by robots.