Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Re^5: Fetching URL

by Corion (Pope)
on Oct 04, 2011 at 11:35 UTC ( #929520=note: print w/ replies, xml ) Need Help??


in reply to Re^4: Fetching URL
in thread Fetching URL

Extract the cookies from the previous request, and generate the content header and content length headers. Also see WWW::Mechanize, which has solved these problems.


Comment on Re^5: Fetching URL
Re^6: Fetching URL
by Shaveta_Chawla (Acolyte) on Oct 04, 2011 at 12:29 UTC
    But this is what the problem is... The cookie information also changes with every request. The code on which i am working is like all the pages are dependent on first page. so the cookie information is same for all the request according to my code. but i need to generate different cookie information with every request which should be same as the source is generating.

      Then, again, you will need to work out what your browser sends if you navigate the website, and, again, replicate what the browser sends from your script. For example, if you want to simulate "open page 1 in one tab", and then "open all linked pages in other tabs, from page 1", the ->back() method of WWW::Mechanize could be of help.

      Again, you have not told me why WWW::Mechanize is insufficient. Please read the documentation and use it or tell us why WWW::Mechanize is insusfficient for your needs.

        Can you help me with the code how to generate header information as i am not able to do that.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://929520]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (3)
As of 2014-09-19 21:58 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (147 votes), past polls