Below is a solution. It uses HTML::TreeBuilder::XPath, which (like Corion) I find easier to use than "bare" HTML::TreeBuilder. I also added an option so while working on the code you don't have to keep hitting the live page. it will be more polite, and for you much faster, to use a cache.
Also, the problems you had with weird characters can be solved by telling the code that you want to output UTF-8, using binmode( STDOUT, ':utf8');.
#!/usr/bin/perl
use strict;
use warnings;
use LWP::Simple;
use Perl6::Slurp; # to load the page from the cache
use HTML::TreeBuilder::XPath; # easier to use than bare HTML::TreeBuil
+der
# during development we don't want to hit the real page,
# so we'll have a -c switch to use a cache
use Getopt::Std;
my %opt;
getopts( 'c', \%opt); # if called with -c then $opt{c} is true
my $base='http://www.costacrociere.it';
my $url='/it/lista_crociere/capitali_nord_europa-201206.html';
my $cache= 'capitali_nord_europa-201206.html';
# this will get rid of the bad characters you were seeing in the outpu
+t
binmode( STDOUT, ':utf8');
if( ! $opt{c}) { getstore( $base.$url, $cache); } # only get the live
+page without -c
my $page= slurp '<:utf8', $cache;
my $p = HTML::TreeBuilder::XPath->new_from_content( $page );
my @trips= $p->findnodes( '//p[@class="itinerari-info"]');
foreach my $trip (@trips){
# you may want to do something more complex here, but for now it wi
+ll do
print "crociera: ", $trip->as_text, "\n";
}
-
Are you posting in the right place? Check out Where do I post X? to know for sure.
-
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big>
<blockquote> <br /> <dd>
<dl> <dt> <em> <font>
<h1> <h2> <h3> <h4>
<h5> <h6> <hr /> <i>
<li> <nbsp> <ol> <p>
<small> <strike> <strong>
<sub> <sup> <table>
<td> <th> <tr> <tt>
<u> <ul>
-
Snippets of code should be wrapped in
<code> tags not
<pre> tags. In fact, <pre>
tags should generally be avoided. If they must
be used, extreme care should be
taken to ensure that their contents do not
have long lines (<70 chars), in order to prevent
horizontal scrolling (and possible janitor
intervention).
-
Want more info? How to link
or How to display code and escape characters
are good places to start.
|