Beefy Boxes and Bandwidth Generously Provided by pair Networks
The stupid question is the question not asked
 
PerlMonks  

Re: RAM: It isn't free . . .

by sundialsvc4 (Abbot)
on Jan 08, 2015 at 00:40 UTC ( #1112595=note: print w/replies, xml ) Need Help??


in reply to RAM: It isn't free . . .

This node falls below the community's threshold of quality. You may see it by logging in.

Replies are listed 'Best First'.
Re^2: RAM: It isn't free . . .(Mike Robinson:criminally inept.)
by BrowserUk (Pope) on Jan 08, 2015 at 01:39 UTC

    I've just run a (not yet thoroughly tested; nor cleaned up; nor even fully optimised) solution to my problem, and the results are promising:

    C:\test>BiMap.pl -S=5 -F=0.6 -I=33554432 Fetch by Addr & Fetch by Name took 18.535743 seconds for 11881376 item +s in a 33554432 sized BiMap Mem: 965,028 K

    For context, here is the single Perl hash solution from the other thread on the same dataset:

    C:\test>1112165-hash.pl Start: mem: 7,892 K 23762752 Hash built: mem: 4,382,916 K Fetch by Name took 7.166012 seconds Fetch by Addr took 7.895133 seconds Hash queried: check mem: 4,382,940 K

    That equates to just 7% longer to run the same dataset using just over 1/5th the memory. Not bad for a fairly crude POC with still considerable potential for further time reduction.

    So, I've expended 3 days -- call it ~50 hrs of my time -- to optimise this.

    No matter how you look at it, that is a far better trade-off than your criminally inept suggestion -- to move to a disk-based DB -- which at (a minimum) of 5000x slower, would cost my customer $2800 * 5000 = $14 million for every hour of processing he intends to do.

    And given the proposal is to run 100 hours of simulations; the net cost of your suggestion would be $1.4 billion - $280,000 = $1.12 $1.39972 *BILLION* of your customer's money that you would be flushing down the drain; and all because you've eschewed learning anything new for the last 30 years; seemingly preferring to remain more an archaeologist, than a programmer.

    I just hope that people will learn from this and finally realise that your malodorously constructed, maliciously provocative, willfully ignorant, hopelessly outdated -- not just non-useful, but perilously inept -- completely worthless, merit-less fluff; is intended to be neither technically useful nor intellectually stimulating; its only purpose being shameful self-promotion of the vilest, any-hits-are-good-hits, form.


    With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

      BrowserUK, you really crack me up...

      Whenever you type something, I envision Major Charles Emerson Winchester III (from M*A*S*H) bellowing out loud invectives to anyone who dares to confront him.

      Not a bad thing, it just amuses me... :-)


      *My* tenacity goes to eleven...
Re^2: RAM: It isn't free . . . (Mike "sundialsvc4" Robinson spams himself)
by Anonymous Monk on Jan 08, 2015 at 00:51 UTC

      After annoying us by repeatedly replying to the wrong post he has finally done it to himself!

      He does it so often it must surely be a deliberate tactic yet I cannot fathom the reason behind it. Has anyone been able to decipher the (surely profound) meaning behind this mysterious "reply to the wrong post" tactic?

        Has anyone been able to decipher the (surely profound) meaning behind this mysterious "reply to the wrong post" tactic?

        The idea appears to be that if the intended target of his post doesn't get a "you've a reply" /msg, then it may take longer for them to reply to it.

        And the longer the post goes without a response, the more likely it is to pick up a few stray upvotes from those that either don't actually read the posts they upvote, or are fooled by his "style" into believing he has something to contribute.

        Do you think that the Perl foundation would fund giving this guy a commission (via an undisclosed third party), in order to discover just how little he knows?

        MS are (finally) starting to fund the taking down of those "We're MS support and we've detected you've got a virus" scam companies. Maybe Perl should do a little housekeeping too.


        With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
        Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
        "Science is about questioning the status quo. Questioning authority".
        In the absence of evidence, opinion is indistinguishable from prejudice. Agile (and TDD) debunked

        Please see Dark triad for details.

        Best regards, Karl

        «The Crux of the Biscuit is the Apostrophe»

    A reply falls below the community's threshold of quality. You may see it by logging in.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1112595]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others cooling their heels in the Monastery: (7)
As of 2021-05-07 09:41 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Perl 7 will be out ...





    Results (90 votes). Check out past polls.

    Notices?