Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses

Re: Fetching URL

by ym_chaitu (Initiate)
on Oct 04, 2011 at 06:11 UTC ( #929447=note: print w/replies, xml ) Need Help??

in reply to Fetching URL

didn't got a clarity on what you are saying but if you like to build a webcrawler then i have written one small code on that which you might be interested in. Webcraler

Replies are listed 'Best First'.
Re^2: Fetching URL
by Shaveta_Chawla (Sexton) on Oct 04, 2011 at 09:53 UTC
    I am trying to fetch a url which contains dynamic value, i have used form method, follow_link method but couldn't succeed. The URL which i have fetched is same that the source is generating but when i am opening that URL on browser,it is giving me wrong page information. May be some cookie based issue.. I am unable to understand the cause as the url is same.. can you guide me what can be the issue..

      You will need to send exactly the same information that your browser sends. Find out what the browser sends, for example using the Mozilla Live Headers extension or using Wireshark, and then replicate that data from your script.

        Actually the Content length, content header and cookies all the values changes with every request.. I am not able to generate the same header information. Can you guide me on this.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://929447]
[stevieb]: perldigious: video near our hq in Montreal. Here in Calgary, it's -28c... we've only got 3" of snow so far, but there are several feet in the mountains already
[perldigious]: Snowshoeing time stevieb? I need to buy a pair so I can walk my German Shepherd properly through the country.
[stevieb]: yeah, I snowshoe a fair amount in the mountains. I also use spikes similar to these very often as well
[perldigious]: Discipulus: alternate link
[stevieb]: LOL you can easily replace "Helsinki" with "Alberta"
[perldigious]: I used to live at the top of a very steep hill stevieb, I can relate to the video. Literally used to have to build up momentum and try to force my vehicle to make it up the hill to park in my driveway properly... didn't always make it.

How do I use this? | Other CB clients
Other Users?
Others lurking in the Monastery: (10)
As of 2016-12-06 16:32 GMT
Find Nodes?
    Voting Booth?
    On a regular basis, I'm most likely to spy upon:

    Results (112 votes). Check out past polls.