Beefy Boxes and Bandwidth Generously Provided by pair Networks
We don't bite newbies here... much
 
PerlMonks  

Re: DBI::SQLite slowness

by sam_bakki (Pilgrim)
on Sep 22, 2013 at 06:18 UTC ( #1055168=note: print w/ replies, xml ) Need Help??


in reply to DBI::SQLite slowness

Hi

If you still like to use SQlite, Try this

$dbHandle->do("PRAGMA journal_mode = WAL");

http://sqlite.org/pragma.html#pragma_journal_mode

Thanks & Regards,
Bakkiaraj M
My Perl Gtk2 technology demo project - http://code.google.com/p/saaral-soft-search-spider/ , contributions are welcome.


Comment on Re: DBI::SQLite slowness
Download Code
Re^2: DBI::SQLite slowness
by erix (Vicar) on Sep 22, 2013 at 06:42 UTC

    Hi

    It looks from that page that DELETE is the default ("The DELETE journaling mode is the normal behavior.").

    Using WAL (Write Ahead Log) is another writing step (slow), so wouldn't it make more sense to switch journaling off:

    $dbHandle->do("PRAGMA journal_mode = OFF");

    That would make the transaction(s) less reliable in case of a crash, but in this particular case that seems unimportant (initial data load, ephemeral data). I would expect journal_mode = OFF to be faster than either the default DELETE, or writing WAL.

    (Then again, I don't use SQLite so I may be completely wrong. If anyone does the tests, I'd be interested to see the speed differences.)

Re^2: DBI::SQLite slowness
by Endless (Beadle) on Sep 23, 2013 at 17:59 UTC
    Thanks for the suggestions. I've tried it with both WAL and OFF without a change in the results on my test-dataset of 83,000 entries. I'll keep it in mind when I try on my real datasets too, though.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1055168]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others romping around the Monastery: (9)
As of 2014-12-23 02:44 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    Is guessing a good strategy for surviving in the IT business?





    Results (133 votes), past polls