Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: $mech->content() returns empty

by sulfericacid (Deacon)
on Oct 14, 2006 at 02:51 UTC ( #578249=note: print w/ replies, xml ) Need Help??


in reply to $mech->content() returns empty

I have a number of web bots I made with WWW::Mechanize and your code looks fine for me.

When using message boards, there's a few things to keep in mind.

  • Some boards have reload times- if you load the page and post the data too quickly, the bot protection will catch you and prevent your last action. Use a 5 or 10 second sleep() time between actions to bypass the bot traps and to be nicer to the server's resources
  • Some forums do use redirects once you sign in or after something is posted. Some forums also require the very next page to load before it'll post your data. If your forum redirects you upon successful login but does not say you logged in, chances are you weren't redirected to the page that set your SSID or cookie. Go through it manually and see where you're being redirected, then load the page using WWW::Mechanize AFTER your last action. I'm 95% certain this is your current problem.


    "Age is nothing more than an inaccurate number bestowed upon us at birth as just another means for others to judge and classify us"

    sulfericacid


  • Comment on Re: $mech->content() returns empty
    Re^2: $mech->content() returns empty
    by Anonymous Monk on Oct 14, 2006 at 03:02 UTC
      That did it!!! I tried your idea of loading the page it redirected me to after the login attempt and it works every time now. Thank you/

    Log In?
    Username:
    Password:

    What's my password?
    Create A New User
    Node Status?
    node history
    Node Type: note [id://578249]
    help
    Chatterbox?
    and the web crawler heard nothing...

    How do I use this? | Other CB clients
    Other Users?
    Others studying the Monastery: (8)
    As of 2014-12-21 17:28 GMT
    Sections?
    Information?
    Find Nodes?
    Leftovers?
      Voting Booth?

      Is guessing a good strategy for surviving in the IT business?





      Results (106 votes), past polls