Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?

Re^5: Bioinformatic task

by erix (Parson)
on Nov 08, 2010 at 13:57 UTC ( #870111=note: print w/replies, xml ) Need Help??

in reply to Re^4: Bioinformatic task
in thread Bioinformatic task

The last time I checked ...

Last time you checked? You didn't check, you took the reported and extremely slow value ("half hour") at face value, instead of comparing your version with a bioperl-version.

In that same thread I showed the difference between bioperl or non-bioperl was much smaller than "half hour" vs "11 seconds".

Now to advocate avoiding a heavy framework for speed is fair enough. But you shouldn't repeat extreme slowness unchecked & unvalidated (it's a bit similar to this slanderous assertion about database - though, of course, that was worse! :) ).

Replies are listed 'Best First'.
Re^6: Bioinformatic task
by BrowserUk (Pope) on Nov 09, 2010 at 01:26 UTC

    True. I took the OP at face value. Just as I did with you and your timings in the db/sort case.

    However, after the I first became aware of the performance problem, I did eventually get (parts of) BioPerl installed on my own (old) machine and verified that the problem existed. I also tried to hunt down the cause.

    One possibility that was muted for this was the use of $`, $& or $'. Although I suggested to the OP that he try Devel::SawAmpersand, there was no follow up, so I hacked my way to installing Bio::SeqIO::fasta and all the required support packages, manually. (The full package has never installed for me.) I didn't detect that particular problem, but saw the machinations the module went through (back then; I see quite a lot of it is now commented out), to read a text file, and attributed the (at that point, quite extreme) slowness to that. I also attempted to track the module changes for a while, but that went out the window when I got my current machine.

    Long story short, when the OP reports "half an hour" for 200MB, that fit with my prior experiences, and I took him at his word. As your reply in that thread was not to me, I probably never saw it. So, if you are responsible for the performance improvements in the module, I congratulate you.

    All of that said, performance was only one of the issues I raised above.

    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://870111]
and God said, "Let Newton be!"...

How do I use this? | Other CB clients
Other Users?
Others chilling in the Monastery: (4)
As of 2017-07-28 11:24 GMT
Find Nodes?
    Voting Booth?
    I came, I saw, I ...

    Results (428 votes). Check out past polls.