Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine
 
PerlMonks  

Re: Best way to aggregate many silos of data into a search form

by TJPride (Pilgrim)
on Nov 30, 2011 at 21:10 UTC ( #940936=note: print w/ replies, xml ) Need Help??


in reply to Best way to aggregate many silos of data into a search form

Well, there are two ways to do this. The first, as suggested above, is to compile the data into a single database. The problem with this is the single database is essentially a mirror of all the existing data, and will have to be kept constantly updated if you want real-time searching. The second is to write a query for each database and then just output all the results on one page. Which method you use largely depends on the number of searches vs the number of updates and how time-sensitive the data is. If you have a large number of global searches, the single database will be more efficient. If there's fewer searches and a lot of updates (and the number of databases is under a few dozen), the multiple-query method may work better. It's hard to give advice without knowing a lot more about your data.


Comment on Re: Best way to aggregate many silos of data into a search form

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://940936]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (6)
As of 2014-09-20 07:00 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (155 votes), past polls