Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl: the Markov chain saw
 
PerlMonks  

Re^3: screen scraping

by Limbic~Region (Chancellor)
on Jan 08, 2005 at 20:06 UTC ( #420581=note: print w/replies, xml ) Need Help??


in reply to Re^2: screen scraping
in thread screen scraping

garskoci,
Are the user and pass fields form values as the WWW::Mechanize example indicates, or are they more like HTTP basic auth like the LWP::UserAgent shows? I am just guessing, but what does the following code do?
#!/usr/bin/perl use strict; use warnings; use WWW::Mechanize; my $mech = WWW::Mechanize->new( autocheck => 1 ); $mech->credentials( '192.168.0.1:80', 'FVS318', 'admin' => 'secret' ); # And then $mech->get() the same as in the LWP::UserAgent code
FWIW, take a look at WWW::Mechanize::Shell as well.

Cheers - L~R

Update: Added a to autocheck

Replies are listed 'Best First'.
Re^4: screen scraping
by garskoci (Novice) on Jan 08, 2005 at 20:16 UTC
    I'm sorry, but like this? I get an error. Remember. Newbie. I am able to log in with the code that you provided.
    #!/usr/bin/perl use strict; use warnings; use WWW::Mechanize; my $mech = WWW::Mechanize->new( utocheck => 1 ); $mech->credentials( '192.168.0.1:80', 'FVS318', 'admin' => 'secret' ); # And then $mech->get() the same as in the LWP::UserAgent code my $mech->get(credentials( '192.168.0.1:80', 'FVS318', 'admin' => 'secret' );
      graskoci,
      I get an error.

      In your original post you said you can not login and in this one you say you get an error. Keep in mind that we can't see what you see so in order to help we need to know what is not working, how it is not working, and what error messages you get. In this case, I believe I made a typo which you could have fixed by RTFMing. Here is the corrected code that should work.

      #!/usr/bin/perl use strict; use warnings; use WWW::Mechanize; my $url = 'http://192.168.0.1/'; # Change if necessary my $mech = WWW::Mechanize->new( autocheck => 1 ); $mech->credentials ( '192.168.0.1:80', 'FVS318', 'admin' => 'secret' ); $mech->get( $url ); # Rest of code goes here
      Incidently, davido had an almost identical problem which you can read about here.

      Cheers - L~R

Re^4: screen scraping
by garskoci (Novice) on Jan 08, 2005 at 20:38 UTC
    Thank you for your help. I will work on this tomorow. I am off to a wedding. Hopefully I can make some progress and post what I have.
    Thank you.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://420581]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (2)
As of 2021-03-09 01:50 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    My favorite kind of desktop background is:











    Results (129 votes). Check out past polls.

    Notices?