Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses
 
PerlMonks  

Re^2: Scrape Yahoo Financial Historical- Process Dataset - format and create dynamic page

by tbone654 (Beadle)
on Sep 21, 2012 at 18:34 UTC ( #994969=note: print w/ replies, xml ) Need Help??


in reply to Re: Scrape Yahoo Financial Historical- Process Dataset - format and create dynamic page
in thread Scrape Yahoo Financial Historical- Process Dataset - format and create dynamic page

I used Finance::QuoteHist::Yahoo to pull the historical data I need to operate on the data. So I will set it up to be dynamically called by a form, and print the output right back to the same webpage.

The problem right now is that yahoo doesn't support the ::Yahoo perl module I need to pull the data directly from the form. I can run it on my laptop and push the output to the yahoo server, but that's not sexy. I guess I have three options here:

  • Move it all to a web server somewhere where perl supports the module.
  • Build my own LAMP server and pay for a static IP, then I control the perl modules (I think?)
  • Use the standard modules which Yahoo supports, plus a few more, and write the excruciatingly painful scraper functions from what's available. (yuck)
  • Run some kind of simple http web server from my laptop that lets me map the perl script from my laptop to a public URL. eg. www.somesmallwebserver.com/3666698/tmp/perlscript.pl Which maps to my /tmp filesystem on my laptop.
  • I am sort of going down the path of the last option for now, just to get it going. I found one that allows downloading files only (brick something) so I was able to download a file from my laptop just fine. So I imagine there are some that just act as a webserver through a similar public ip address schema?

    Thank you for your reply. Good luck with that value investing thing, I'm an action junkie, so I need to move pretty fast and must have fairly live data.


    Comment on Re^2: Scrape Yahoo Financial Historical- Process Dataset - format and create dynamic page
    Replies are listed 'Best First'.
    Re^3: Scrape Yahoo Financial Historical- Process Dataset - format and create dynamic page
    by Anonymous Monk on Sep 21, 2012 at 22:10 UTC

      The problem right now is that yahoo doesn't support the ::Yahoo perl module

      You can, like, install the module

        How do you get Yahoo web hosting to install the module?

    Log In?
    Username:
    Password:

    What's my password?
    Create A New User
    Node Status?
    node history
    Node Type: note [id://994969]
    help
    Chatterbox?
    and the web crawler heard nothing...

    How do I use this? | Other CB clients
    Other Users?
    Others chilling in the Monastery: (13)
    As of 2015-07-07 22:28 GMT
    Sections?
    Information?
    Find Nodes?
    Leftovers?
      Voting Booth?

      The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









      Results (93 votes), past polls