Beefy Boxes and Bandwidth Generously Provided by pair Networks
"be consistent"
 
PerlMonks  

Re^8: Threads and DBD::SQLite?

by erix (Parson)
on Dec 17, 2013 at 08:37 UTC ( #1067432=note: print w/replies, xml ) Need Help??


in reply to Re^7: Threads and DBD::SQLite?
in thread Threads and DBD::SQLite?

OK, so my numbers for "Read all 100000 records using 4 threads" were really

" Read ", $R * 100 / $N, " % of all records using 4 threads"

that means the test was doing 0.1 % of what the output-line was saying.

Here is a run without that mistake:

# The offending code line changed to: # $Q->nq( $_ ) for (shuffle 1 .. $N); SQLite - 5.90120077 s - Populate db with 100000 rows SQLite - 0.15266800 s - Create primary index SQLite - 0.53022408 s - Read all 100000 rows, unthreaded SQLite - 7.23427510 s - Read all 100000 rows, 4 threads Pg - 23.40106297 s - Populate db with 100000 rows Pg - 0.53076911 s - Create primary index Pg - 13.71553111 s - Read all 100000 rows, unthreaded Pg - 7.40499115 s - Read all 100000 rows, 4 threads

Replies are listed 'Best First'.
Re^9: Threads and DBD::SQLite?
by BrowserUk (Pope) on Dec 17, 2013 at 08:54 UTC
    so my numbers

    Not only your numbers, mine also. Another forgotten artifact from when I was testing this a couple of months ago.

    Your latest output makes for intriguing reading. The Pg 1 thread versus 4 threads is sort of what you'd expect.

    The sqlite numbers make no sense at all. It looks like it has to re-build the cache from scratch for the new connections?

    Those kind of numbers combined with my inability to get a memorydb combined with shared db via multiple connections tell me that this stuff isn't ready for prime time yet.

    Thanks for your help.


    With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1067432]
help
Chatterbox?
[Sinistral]: I think that just the sight of his username now causes a downvote storm. I agree, and the gratuitous use of formatting does make reading hard. I've given him +1 on things where there seemed to be actual good advice, but I think the big
[Sinistral]: nail in coffin was the rant against a Schwarzian Transform
[stonecolddevin]: at best, from what i've seen, his knowledge is accurate up to maybe 2002. the sheer volume of words is mostly worthy of a downvote in most cases though i think
[erix]: ITYM Schwartzian Transform :P
[erix]: hey planetscape :)
[planetscape]: howdy stonecolddevin, erix
[Sinistral]: eric Aye. I thought I typed that wrong. All hail Randall! I listen to him on FLOSS Weekly
[Discipulus]: i think his vacuus, trombon like, absence of meaning, joined with a ostentatious style, after many years irritates the most
[erix]: easy to get wrong -- I guess that was sund's point, too :P
[Discipulus]: planetscape welcome back! (or is well comeback?)

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (10)
As of 2017-06-22 20:56 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    How many monitors do you use while coding?















    Results (530 votes). Check out past polls.