Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re^3: Perl Automation

by marto (Chancellor)
on Nov 22, 2012 at 09:32 UTC ( #1005093=note: print w/ replies, xml ) Need Help??


in reply to Re^2: Perl Automation
in thread Perl Automation

I'd expect a degree student to be able to do some research on their own, I'm sure you'd find it was against their Terms and Conditions of use to automate this had you bothered to do any. Finding a way to contact them is hardly taxing.


Comment on Re^3: Perl Automation
Re^4: Perl Automation
by Anonymous Monk on Nov 22, 2012 at 18:24 UTC

    Thanks Marto. I know its against their terms and conditions, but i need to do it. I am doing research on this and found that www:mech:firefox can do something, but I am stuck at the last part now. The page have a button(not button really) named "Download" which on click should PopUp a small window which have "All search results". This pop up is not happening. Actually I can click that "Download" but the popup is not coming(with the script). In browser(Firefox) manually it is coming, when the "Download" is clicked and we can do the rest process but in this case its not going beyond that. I hope you can help me. Dont think that I am scraping google, just think that I am asking a general question, but pls can you let me know what maybe the issue or how I can overcome this kind of 'popup issues. Thanks.

    =================================================

    The biggest crawler/spider/bot(/ or whatever) on this earth is google & I dont think that it is unfair to crawl them(even if it is in their TOC).!

      "The biggest crawler/spider/bot(/ or whatever) on this earth is google & I dont think that it is unfair to crawl them(even if it is in their TOC).!"

      Actually, that's why they provide an API, an Application Programming Interface, to their products. What you regard as "fair" doesn't come into it. Your educational establishment will likely want you to behave within the law, a reasonable body would actually cover any (probably minimal) costs involved. Since you seem unable to find out how to contact Google I doubt this will have any impact on you.

      You don't "need to do it", you simply want to.

        okay... I resign...!

        but can you pls tell me how we can deal with Popups? just asking in general... just wish to know about it thats all. or that kinda things not possible with mech:firefox...? The documentation says emulating everything that a user can do is also possible with this module, but clicking for a popup with mech:firefox doesnt do so!, then what could be the issue..? (Expecting a suggestion)

        Thank you.

      Thanks Marto. I know its against their terms and conditions, but i need to do it.

      We need to avoid helping you.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1005093]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others meditating upon the Monastery: (7)
As of 2014-11-23 06:11 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My preferred Perl binaries come from:














    Results (128 votes), past polls