![]() |
|
Think about Loose Coupling | |
PerlMonks |
Re^2: Writing inverted index code in perl might be overkillby dpavlin (Friar) |
on Aug 19, 2005 at 16:57 UTC ( [id://485209]=note: print w/replies, xml ) | Need Help?? |
That's actually possible using existing horisontal scalability of HyperEstraier.
Just setup multiple servers which crawl separate parts of web. Setup search to search over all nodes at once.
I don't have pointer to perl solution for this (other than CPAN modules which make every problem 90% done). On the other hand, with current P2P architecture you can have multiple indexes (for e-mail, documents, etc.) and search over just some or all of them. 2share!2flame...
In Section
Seekers of Perl Wisdom
|
|