Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot
 
PerlMonks  

Re: perl mysql full table scan

by sundialsvc4 (Abbot)
on Jul 10, 2013 at 12:09 UTC ( #1043458=note: print w/ replies, xml ) Need Help??


in reply to perl mysql full table scan

You might have to do both.   Be sure, however, that MySQL is doing all the filtering that it can, because you don’t want to send those millions-of-rows across a network-wire between two servers, just to throw away nearly-all of them.   (Whereas doing a local-disk-drive scan of millions of rows is actually not so bad.)

Also, seriously consider any features that MySQL may offer, including its word-based indexing capabilities for large-text fields.   If you do this stuff “frequently,” it becomes the classic tradeoff of Speed vs. Space, in several ways.   Benchmark your ideas carefully.


Comment on Re: perl mysql full table scan

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1043458]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (15)
As of 2015-07-07 09:48 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (88 votes), past polls