Beefy Boxes and Bandwidth Generously Provided by pair Networks
P is for Practical

Re: DBI: How to update 150K records efficiently

by moritz (Cardinal)
on Mar 31, 2008 at 14:10 UTC ( #677524=note: print w/replies, xml ) Need Help??

in reply to DBI: How to update 150K records efficiently

If you haven't benchmarked it yet, try this:
my $sth = $dbh->prepare('UPDATE myTable SET va = ?, vb = ? WHERE vc = +?'); while (my $record = <$input>){ my @values = (split(/\|/,$record))[1,3,5]; $sth->execute(@values); } $sth->finish()

At least it avoids generating hashes for everything, and it uses a cached "prepared statement".

Replies are listed 'Best First'.
Re^2: DBI: How to update 150K records efficiently
by Juerd (Abbot) on Mar 31, 2008 at 15:16 UTC

    Oh, but the OP's code also uses a cached prepared statement. DBIx::Simple handles this internally. The problem is that before it can access the cache, it has to generate the query string all over :)

    Juerd # { site => '', do_not_use => 'spamtrap', perl6_server => 'feather' }

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://677524]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (6)
As of 2016-10-26 23:45 GMT
Find Nodes?
    Voting Booth?
    How many different varieties (color, size, etc) of socks do you have in your sock drawer?

    Results (350 votes). Check out past polls.