Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things
 
PerlMonks  

Re: LWP Posting login/redirect

by elwarren (Curate)
on Oct 27, 2004 at 00:08 UTC ( #402857=note: print w/ replies, xml ) Need Help??


in reply to LWP Posting login/redirect

LWP will by default follow redirects between 10-15 times before giving up. It is a configurable parameter. Some of the more intelligent sites will also ignore you if your UserAgent isn't something well known like Mozilla or IE. Change the default UA string to avoid discrimination. Finally, some more intelligent (or not) sites will check your referer to try and avoid deep linking or (again) scripted webcrawlers.

Lucky for us, all of these defenses can be overcome with LWP. Long live Perl! The swiss-army chainsaw!


Comment on Re: LWP Posting login/redirect

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://402857]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others surveying the Monastery: (11)
As of 2014-10-02 14:18 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    What is your favourite meta-syntactic variable name?














    Results (61 votes), past polls