Beefy Boxes and Bandwidth Generously Provided by pair Networks Joe
"be consistent"
 
PerlMonks  

Re: Speed up DBD::MySQL Queries

by Roger_B (Scribe)
on Oct 05, 2005 at 17:17 UTC ( [id://497750]=note: print w/replies, xml ) Need Help??

This is an archived low-energy page for bots and other anonmyous visitors. Please sign up if you are a human and want to interact.


in reply to Speed up DBD::MySQL Queries

You've had some good advice, particularly doing the join on the database rather than in Perl. I'd like to comment on the following observation:

it seems to crunch about 5000 rows at once then rests for 5 minutes. I'm not sure what it's doing.

This is probably due to buffering; output is accumulating in a buffer at a relatively steady rate until the buffer fills, then you get a whole lot of results as the buffer is flushed. As you're doing the join manually in Perl, this is most likely to be buffering of Perl's output, so I'm guessing you must be writing to a file (Perl 'typically' has line buffering when writing to a terminal and block buffering otherwise).

HTH

Roger

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://497750]
help
Sections?
Information?
Find Nodes?
Leftovers?
    Notices?
    hippoepoptai's answer Re: how do I set a cookie and redirect was blessed by hippo!
    erzuuliAnonymous Monks are no longer allowed to use Super Search, due to an excessive use of this resource by robots.