http://www.perlmonks.org?node_id=929298

Shaveta_Chawla has asked for the wisdom of the Perl Monks concerning the following question:

I am trying to fetch a url from a site. i have used form method to fetch URL and successfully fetched first page URL.i have just submitted basic URL where search page is available. The code used is::

my @forms = HTML::Form->parse($res); @forms = grep{$_->attr('name') eq 'adv_search_form'} @forms; my $form = shift @forms; my $req = $form->make_request;
the URL generates dynamic value. when i am trying to fetch second page URL, means next page request the code used is::
my $referer = $res->request->uri; my $uri = $res->request->uri; my $headers = $res->request->headers; my %link_tags = ( a => 'href', ); my $parser = HTML::TokeParser->new(\$res->decoded_content()); while ( my $token = $parser->get_tag( keys %link_tags ) ) { my $attrs = $token->[1]; my $text = $parser->get_trimmed_text("/a"); my $url = $attrs->{$link_tags{'a'}}; if($text eq 'Next page') { $url2 = "abc.com" . $url; } $headers->header(referer => $referer); my $req = HTTP::Request->new('GET', $url2, $headers); return $req;
i have got the exact URL but that URL is not working. Please help me out...