Beefy Boxes and Bandwidth Generously Provided by pair Networks
go ahead... be a heretic

comment on

( #3333=superdoc: print w/replies, xml ) Need Help??
Hello, I am not really a programmer, but can write perl/tcl/c\++, and so on.
My task is to automate logging on to a few httpS websites (cookies, redirects and all), and to scrape the screens, putting the data (lots of it) into a excel spreadsheet. Automating the spreadsheet manipulation of the data, and then putting the resultant data back on a site through mimicking a human user's interaction with a site.

I have been researching the tools to do that, and am finally completely confused:
I tried perl LWP/Mechanize, and got stuck after one of the pages i need to talk to says my browser does not support javascript and cascading frames.
I then thought that a better way to do the job would be to automate IE itself since I know it is supported, plus I can see what's going on.

I now found a bunch of tools similar to samie, and my question really is what is the right tool for the job? Do i not know enough about perl to make it work with JavaScript, why not use VB to automate IE (a lot of people seem to be doing that), and can perl let me pull up excel, and run macros in it like VB would.

I know this is alot of questions (reflecting of my state of confusion) but any comments are much appreciated, thanks in advance...

In reply to Re^2: On being a browser by Anonymous Monk
in thread On being a browser by rkg

Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post; it's "PerlMonks-approved HTML":

  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.
  • Log In?

    What's my password?
    Create A New User
    and the web crawler heard nothing...

    How do I use this? | Other CB clients
    Other Users?
    Others romping around the Monastery: (4)
    As of 2020-06-06 14:52 GMT
    Find Nodes?
      Voting Booth?
      Do you really want to know if there is extraterrestrial life?

      Results (41 votes). Check out past polls.