Beefy Boxes and Bandwidth Generously Provided by pair Networks
Syntactic Confectionery Delight
 
PerlMonks  

Re^5: Bioinformatic task

by erix (Vicar)
on Nov 08, 2010 at 13:57 UTC ( #870111=note: print w/ replies, xml ) Need Help??


in reply to Re^4: Bioinformatic task
in thread Bioinformatic task

The last time I checked ...

Last time you checked? You didn't check, you took the reported and extremely slow value ("half hour") at face value, instead of comparing your version with a bioperl-version.

In that same thread I showed the difference between bioperl or non-bioperl was much smaller than "half hour" vs "11 seconds".

Now to advocate avoiding a heavy framework for speed is fair enough. But you shouldn't repeat extreme slowness unchecked & unvalidated (it's a bit similar to this slanderous assertion about database - though, of course, that was worse! :) ).


Comment on Re^5: Bioinformatic task
Re^6: Bioinformatic task
by BrowserUk (Pope) on Nov 09, 2010 at 01:26 UTC

    True. I took the OP at face value. Just as I did with you and your timings in the db/sort case.

    However, after the I first became aware of the performance problem, I did eventually get (parts of) BioPerl installed on my own (old) machine and verified that the problem existed. I also tried to hunt down the cause.

    One possibility that was muted for this was the use of $`, $& or $'. Although I suggested to the OP that he try Devel::SawAmpersand, there was no follow up, so I hacked my way to installing Bio::SeqIO::fasta and all the required support packages, manually. (The full package has never installed for me.) I didn't detect that particular problem, but saw the machinations the module went through (back then; I see quite a lot of it is now commented out), to read a text file, and attributed the (at that point, quite extreme) slowness to that. I also attempted to track the module changes for a while, but that went out the window when I got my current machine.

    Long story short, when the OP reports "half an hour" for 200MB, that fit with my prior experiences, and I took him at his word. As your reply in that thread was not to me, I probably never saw it. So, if you are responsible for the performance improvements in the module, I congratulate you.

    All of that said, performance was only one of the issues I raised above.


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://870111]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others meditating upon the Monastery: (4)
As of 2014-11-23 05:55 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My preferred Perl binaries come from:














    Results (128 votes), past polls