Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?
 
PerlMonks  

Re: Help With Online Table Scraper

by Sinistral (Prior)
on Mar 02, 2011 at 14:28 UTC ( #890993=note: print w/replies, xml ) Need Help??


in reply to Help With Online Table Scraper

Before anyone starts talking about doing HTML scraping these days, it's always important to ask the question, "Is there a better way to do this?". The answer, direct from Yahoo, is yes, yes there is. Use web APIs, not HTML scraping (and YQL is your friend). This way, if Yahoo changes the syntax of their HTML (which can happen at a moment's notice), your tool will continue working.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://890993]
help
Chatterbox?
[Corion]: choroba: Yeah - I found that if you have the "right" datastructure from the start, it's fairly easy, but if you have some global datastructure that you mutate, you have to rewrite a lot to pass around the results instead.
[Corion]: I find the process quite similar to (in Prolog) passing around an accumulator variable in recursive predicates

How do I use this? | Other CB clients
Other Users?
Others scrutinizing the Monastery: (6)
As of 2017-12-11 11:23 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    What programming language do you hate the most?




















    Results (289 votes). Check out past polls.

    Notices?