Re: Parsing HTML

[thunders]

Many of the modules that inherit from HTML::Parser are quite capable for this kind of task. I like HTML::TokeParser::Simple.

#!/usr/bin/perl -w

use strict;
use LWP::Simple;
use HTML::TokeParser::Simple;

my $site = $ARGV[0];
my $content = get($site);
my $parser = HTML::TokeParser::Simple->new(\$content);

while ( my $token = $parser->get_token ) {
    next unless $token->is_text;
    print $token->as_is;
}