Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

Re: How to screen-scrape a page that uses a Java applet for authentication?

by Corion (Patriarch)
on Sep 09, 2004 at 09:16 UTC ( [id://389596]=note: print w/replies, xml ) Need Help??


in reply to How to screen-scrape a page that uses a Java applet for authentication?

As the Java applet has to respect your proxy settings, first try if the Java applet uses simple HTTP requests by setting up a small logging proxy, possibly through HTTP::Recorder or HTTP::Proxy.

If the Java applet connects through a different port than port 80, and doesn't use HTTP, you will have to break out an actual network sniffer and sniff the connection. I would use Net::PCap as the sniffer, because in the end you will want to write Perl code to emulate the Java applet anyway, but of course if you're more comfortable with ethereal or tcpdump, use that.

  • Comment on Re: How to screen-scrape a page that uses a Java applet for authentication?

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://389596]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others avoiding work at the Monastery: (6)
As of 2024-04-23 12:10 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found