Beefy Boxes and Bandwidth Generously Provided by pair Networks
laziness, impatience, and hubris
 
PerlMonks  

Re: Best way to aggregate many silos of data into a search form

by TJPride (Pilgrim)
on Nov 30, 2011 at 21:10 UTC ( #940936=note: print w/replies, xml ) Need Help??


in reply to Best way to aggregate many silos of data into a search form

Well, there are two ways to do this. The first, as suggested above, is to compile the data into a single database. The problem with this is the single database is essentially a mirror of all the existing data, and will have to be kept constantly updated if you want real-time searching. The second is to write a query for each database and then just output all the results on one page. Which method you use largely depends on the number of searches vs the number of updates and how time-sensitive the data is. If you have a large number of global searches, the single database will be more efficient. If there's fewer searches and a lot of updates (and the number of databases is under a few dozen), the multiple-query method may work better. It's hard to give advice without knowing a lot more about your data.
  • Comment on Re: Best way to aggregate many silos of data into a search form

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://940936]
help
Chatterbox?
[Your Mother]: Cumin? Now I want tacos...
[Eily]: there should be an option in grep for fuzzy order of the letters in the pattern
[Eily]: as in "I might have inverted two, but my eyes misread in the some order as my fingers mistype"
[LanX]: can't find a definition for the sound
[LanX]: Voiceless_palatal_ fricative
[Eily]: Lanx https://en. wikipedia.org/ wiki/Voiceless_pal atal_fricative
Eily got the Cowboy message

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (13)
As of 2017-03-27 17:00 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Should Pluto Get Its Planethood Back?



    Results (320 votes). Check out past polls.