Shaveta_Chawla has asked for the wisdom of the Perl Monks concerning the following question:
I am trying to fetch a url from a site. i have used form method to fetch URL and successfully fetched first page URL.i have just submitted basic URL where search page is available. The code used is::
the URL generates dynamic value. when i am trying to fetch second page URL, means next page request the code used is::my @forms = HTML::Form->parse($res); @forms = grep{$_->attr('name') eq 'adv_search_form'} @forms; my $form = shift @forms; my $req = $form->make_request;
i have got the exact URL but that URL is not working. Please help me out...my $referer = $res->request->uri; my $uri = $res->request->uri; my $headers = $res->request->headers; my %link_tags = ( a => 'href', ); my $parser = HTML::TokeParser->new(\$res->decoded_content()); while ( my $token = $parser->get_tag( keys %link_tags ) ) { my $attrs = $token->[1]; my $text = $parser->get_trimmed_text("/a"); my $url = $attrs->{$link_tags{'a'}}; if($text eq 'Next page') { $url2 = "abc.com" . $url; } $headers->header(referer => $referer); my $req = HTTP::Request->new('GET', $url2, $headers); return $req;
|
---|
Replies are listed 'Best First'. | |
---|---|
Re: Fetching URL
by Corion (Patriarch) on Oct 03, 2011 at 09:42 UTC | |
Re: Fetching URL
by Priti24 (Novice) on Oct 03, 2011 at 09:40 UTC | |
Re: Fetching URL
by ym_chaitu (Initiate) on Oct 04, 2011 at 06:11 UTC | |
by Shaveta_Chawla (Sexton) on Oct 04, 2011 at 09:53 UTC | |
by Corion (Patriarch) on Oct 04, 2011 at 10:04 UTC | |
by Shaveta_Chawla (Sexton) on Oct 04, 2011 at 10:28 UTC | |
by Corion (Patriarch) on Oct 04, 2011 at 11:35 UTC | |
| |
Re: Fetching URL
by Shaveta_Chawla (Sexton) on Oct 04, 2011 at 11:02 UTC |
Back to
Seekers of Perl Wisdom