Beefy Boxes and Bandwidth Generously Provided by pair Networks DiBona
Perl-Sensitive Sunglasses
 
PerlMonks  

Re: HTML::SimpleParse to parse HTML

by bitingduck (Friar)
on Dec 11, 2012 at 05:32 UTC ( #1008215=note: print w/ replies, xml ) Need Help??


in reply to HTML::SimpleParse to parse HTML

Try running this:

#!usr/bin/perl #simpleparse.pl use strict; use warnings; use HTML::SimpleParse; use Data::Dumper; my $html = <<'END'; <div class="views-field views-field-title"> <span class="fiel +d-content"><a href="/MAKER/gen/id01">Completed 3:46 pm, 06 Dec, 2012< +/a></span> </div> <div class="views-field views-field-title"> <span class="fiel +d-content"><a href="/MAKER/gen/id02">Completed 4:00 pm, 06 Dec, 2012< +/a></span> </div> END my $p=HTML::SimpleParse->new($html); print Dumper($p);

And see what the data structure from HTML::SimpleParse looks like. It flattens everything out so that it removes all the structure that helps you figure out what you want. You could probably cook up some combination of conditionals to sort out what shows up in what order to get the urls you want, but a fancier module will make your life easier, at the expense of having to read more of the manual.

Here's a solution using HTML::TreeBuilder (which uses HTML::Element for a lot of the interesting stuff)
#!usr/bin/perl #simpleparse.pl use strict; use warnings; use HTML::TreeBuilder; use Data::Dumper; my $html = <<'END'; <div class="views-field views-field-title"> <span class="fiel +d-content"><a href="/MAKER/gen/id01">Completed 3:46 pm, 06 Dec, 2012< +/a></span> </div> <div class="views-field views-field-title"> <span class="fiel +d-content"><a href="/MAKER/gen/id02">Completed 4:00 pm, 06 Dec, 2012< +/a></span> </div> <div class="views-field views-field-title"> <span class="fiel +d-content"><a href="/MAKER/gen/id03">Not Completed 3:46 pm, 06 Dec, 2 +012</a></span> </div> <div class="views-field views-field-title"> <span class="fiel +d-content"><a href="/MAKER/gen/id04">Something done 4:00 pm, 06 Dec, +2012</a></span> </div> END my $p=HTML::TreeBuilder->new_from_content($html); my @urls=$p->find('_tag'=>'a'); foreach (@urls){ if ($_->as_text=~/^Completed/){ print $_->attr('href')."\n"; } } #print Dumper($p);

If you want to see how HTML::TreeBuilder parses your HTML into a structure, uncomment the last line with print Dumper($p). Compare that to what HTML::Simple does when it parses. It's a lot more complicated, but TreeBuilder and Element have a lot of methods to make that all mostly transparent.


Comment on Re: HTML::SimpleParse to parse HTML
Select or Download Code
Re^2: HTML::SimpleParse to parse HTML
by techie411 (Acolyte) on Dec 11, 2012 at 23:16 UTC
    @bitingduck - Thanks a lot for providing an example, I appreciate it! I did end up using HTML::TreeBuilder! :)

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1008215]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others drinking their drinks and smoking their pipes about the Monastery: (5)
As of 2014-04-18 00:19 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    April first is:







    Results (460 votes), past polls