Beefy Boxes and Bandwidth Generously Provided by pair Networks
go ahead... be a heretic
 
PerlMonks  

Re^2: On being a browser

by Anonymous Monk
on Sep 27, 2007 at 01:36 UTC ( #641261=note: print w/replies, xml ) Need Help??


in reply to Re: On being a browser
in thread On being a browser

Hello, I am not really a programmer, but can write perl/tcl/c\++, and so on.
My task is to automate logging on to a few httpS websites (cookies, redirects and all), and to scrape the screens, putting the data (lots of it) into a excel spreadsheet. Automating the spreadsheet manipulation of the data, and then putting the resultant data back on a site through mimicking a human user's interaction with a site.

I have been researching the tools to do that, and am finally completely confused:
I tried perl LWP/Mechanize, and got stuck after one of the pages i need to talk to says my browser does not support javascript and cascading frames.
I then thought that a better way to do the job would be to automate IE itself since I know it is supported, plus I can see what's going on.

I now found a bunch of tools similar to samie, and my question really is what is the right tool for the job? Do i not know enough about perl to make it work with JavaScript, why not use VB to automate IE (a lot of people seem to be doing that), and can perl let me pull up excel, and run macros in it like VB would.

I know this is alot of questions (reflecting of my state of confusion) but any comments are much appreciated, thanks in advance...

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://641261]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (4)
As of 2020-06-05 06:18 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Do you really want to know if there is extraterrestrial life?



    Results (35 votes). Check out past polls.

    Notices?