Beefy Boxes and Bandwidth Generously Provided by pair Networks
"be consistent"
 
PerlMonks  

Re: DBI vs Bulk Loading

by pboin (Deacon)
on Sep 15, 2005 at 12:30 UTC ( [id://492184]=note: print w/replies, xml ) Need Help??


in reply to DBI vs Bulk Loading

I'm not sure exactly what you mean by 'summing the data' when you get the second hit on a key, but here's my first thought:

I'd consider loading up a hash, always 'summing up' the values. Do that for all of your log files. Then, you'll have a hash all populated and ready to go. You can either use DBI to insert into mySql, or you can write out to CSV and load later. (Is this a regular or a one-time event?)

PS: If you want performance, make sure you understand how your transactions work. It can make a huge difference, especially in my personal preference: SQLite.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://492184]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others surveying the Monastery: (3)
As of 2024-04-24 01:35 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found