in reply to Re: multi threading DBI
in thread multi threading DBI
I'm the OP. Thanks everyone and just to clarify a bit more: the script is slow because of the single thread internet connection. Yes, writing to sqlite is not fast (compared to most other real database server), but it is insignificant compared to grabbing stuff from the internet.
Thanks BrowserUK for the list of stuff, I'm still going thru that, haven't found some source code that I can use yet. Meanwhile, I am actually opening a new dbh in each thread of my scrapper (stupid and not efficient.....)
|
---|
Replies are listed 'Best First'. | |
---|---|
Re^3: multi threading DBI
by BrowserUk (Patriarch) on Oct 30, 2013 at 07:55 UTC | |
by Anonymous Monk on Oct 30, 2013 at 19:01 UTC | |
by BrowserUk (Patriarch) on Oct 30, 2013 at 20:08 UTC | |
by Anonymous Monk on Oct 31, 2013 at 06:56 UTC | |
by BrowserUk (Patriarch) on Oct 31, 2013 at 06:59 UTC | |
|
In Section
Seekers of Perl Wisdom