Beefy Boxes and Bandwidth Generously Provided by pair Networks
Just another Perl shrine
 
PerlMonks  

Re^2: Bulk data insertion into MySql

by sowraaj (Novice)
on Sep 03, 2011 at 12:31 UTC ( #923984=note: print w/ replies, xml ) Need Help??


in reply to Re: Bulk data insertion into MySql
in thread Bulk data insertion into MySql

Dear friend,

I tried the method Auto_commit& Commit in my coding but i noted that there is not large difference compare to my previous code. If you know any method which is helped to enhance the insertion time by bulk loading . (Now i insert 10,00,000rows/2min)I would like to reduce that time to seconds

Thanks


Comment on Re^2: Bulk data insertion into MySql
Replies are listed 'Best First'.
Re^3: Bulk data insertion into MySql
by Anonymous Monk on Sep 03, 2011 at 19:45 UTC

    If you can already insert one million rows in two minutes, that seems like a very good speed to me.

    Your task looks like a one-time script to import ("bulk load") a number of files into the database. Why do you need it faster? How often do you need to run it?

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://923984]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others perusing the Monastery: (8)
As of 2015-07-31 03:07 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (274 votes), past polls