Re^2: Remote Login and Form Posting

I have looked at that module and I don't see how to use a cookie_jar with it to first login to their website. I am looking through the module on cpan with the doc therein contained.

I have put a TON of time into this and don't want to start at ground zero, unless I have to. Therefore, how would I get what I have already written to work?

I added all the form fields to the LWP version I made, but it does not seem to be doing it right. Is there a way to make this code here work:

use HTTP::Request;
use HTTP::Cookies;
my $_cookie_file = "/home/first/cook/.lwp_cookies.dat";
  $_post_url = 'http://www.eb2b.net/E2B_UMLogOn.process';
# Create new LWP::UserAgent object
  $browser = LWP::UserAgent->new;
# Add a new Cookie Jar to the LWP Object
  $browser->cookie_jar(HTTP::Cookies->new("file" => $_cookie_file));
# Spoof a very capable browser
  $browser->agent('Mozilla/5.0');
# Allow https protocol and http....
  $browser->protocols_allowed( [ 'http', 'https'] );
# Add the HTTP::Request for POST...
  $req = HTTP::Request->new("POST" => "$_post_url");
# Add "content type" as form encoded
  $req->content_type("application/x-www-form-urlencoded");
# Add the "Form fields" that are contained in the page...
  $req->content("IWPEProcessFlow.submitted.sequenceID=&logonUsername=m
+yhiddenusername&logonPassword=myhiddenpass&Logon=Login&hMsgUserNotFou
+nd=User with this name was not found.&hMsgInvalidPassword=Logon not v
+alid.&fromHomePage=default_B2B.htm");
# Spoof the referrer to make the site think it's a person
# from the login page...
  $req->referrer("http://www.eb2b.net/Templates/UM/RegisterCustomer/E2
+B_UMLogon.tem");
# Ok, now Perform Task
  $response = $browser->request($req);

if($response->is_success) {
# This is not working as it is posting in the 'ELSE' statement. It is 
+actually posting this in the "$response->content" field:

START $response->content
<HTML>
<!-- IWLoadCurrentCustomerLocale.tem -
      -- Copyright (c) 1997 InterWorld Corporation --> 
<HEAD>      
<META HTTP-EQUIV=REFRESH CONTENT="1;URL=/E2B_UMLogOn.process">
<TITLE>Refresh User Repository</TITLE>
</HEAD>

<BODY BGCOLOR="#ffffff">

<!--<A HREF="/E2B_UMLogOn.process">
<FONT SIZE="3" FACE="verdana, arial, helvetica">Please click here to c
+ontinue...</FONT></A>
-->
</BODY>
</HTML>
END $response->content
[download]

If not I'll try to figure out how to use the WWW::Mechanize module.

Thank you for any further assistance you can be.

Richard

Comment on Re^2: Remote Login and Form Posting Download Code

Replies are listed 'Best First'.

Re^3: Remote Login and Form Posting
by Corion (Patriarch) on Jul 01, 2004 at 07:56 UTC

I have put a TON of time into this and don't want to start at ground zero, unless I have to. Therefore, how would I get what I have already written to work?

In short, no. Putting "TONs of time" into automating a web site without looking at a working connection will never work, or at least require inordinate amounts of "TONs of time".

I recommend that you record a complete session with the actual browser, and that you don't fake a non-existing browser that has the UserAgent header Mozilla/5.0 - please look at the traffic sent by LWP and compare it to the traffic sent by your browser. Pretending to be a browser starts by sending the same data as the browser.

I can only recommend to you to try a different route and let the code you alreday have lie still for a while. Try the approach of imitating a browser by mimicking exactly what it does by actually striving to send the data identically to what the browser would send.

HTTP::Recorder (by leira) and WWW::Mechanize::Shell (by me) are two modules that will try to write WWW::Mechanize scripts for you, and maybe they will already suffice, but I cannot stress enough the point of comparing at what your script is sending against the working solution of what your browser is sending.

[reply]


No such thing as a small change
	PerlMonks