Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine
 
PerlMonks  

Re^4: Fetching URL

by Shaveta_Chawla (Acolyte)
on Oct 04, 2011 at 10:28 UTC ( #929497=note: print w/ replies, xml ) Need Help??


in reply to Re^3: Fetching URL
in thread Fetching URL

Actually the Content length, content header and cookies all the values changes with every request.. I am not able to generate the same header information. Can you guide me on this.


Comment on Re^4: Fetching URL
Re^5: Fetching URL
by Corion (Pope) on Oct 04, 2011 at 11:35 UTC

    Extract the cookies from the previous request, and generate the content header and content length headers. Also see WWW::Mechanize, which has solved these problems.

      But this is what the problem is... The cookie information also changes with every request. The code on which i am working is like all the pages are dependent on first page. so the cookie information is same for all the request according to my code. but i need to generate different cookie information with every request which should be same as the source is generating.

        Then, again, you will need to work out what your browser sends if you navigate the website, and, again, replicate what the browser sends from your script. For example, if you want to simulate "open page 1 in one tab", and then "open all linked pages in other tabs, from page 1", the ->back() method of WWW::Mechanize could be of help.

        Again, you have not told me why WWW::Mechanize is insufficient. Please read the documentation and use it or tell us why WWW::Mechanize is insusfficient for your needs.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://929497]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others wandering the Monastery: (5)
As of 2014-11-23 02:18 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My preferred Perl binaries come from:














    Results (127 votes), past polls