Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re^5: Bioinformatic task

by erix (Vicar)
on Nov 08, 2010 at 13:57 UTC ( #870111=note: print w/ replies, xml ) Need Help??


in reply to Re^4: Bioinformatic task
in thread Bioinformatic task

The last time I checked ...

Last time you checked? You didn't check, you took the reported and extremely slow value ("half hour") at face value, instead of comparing your version with a bioperl-version.

In that same thread I showed the difference between bioperl or non-bioperl was much smaller than "half hour" vs "11 seconds".

Now to advocate avoiding a heavy framework for speed is fair enough. But you shouldn't repeat extreme slowness unchecked & unvalidated (it's a bit similar to this slanderous assertion about database - though, of course, that was worse! :) ).


Comment on Re^5: Bioinformatic task
Re^6: Bioinformatic task
by BrowserUk (Pope) on Nov 09, 2010 at 01:26 UTC

    True. I took the OP at face value. Just as I did with you and your timings in the db/sort case.

    However, after the I first became aware of the performance problem, I did eventually get (parts of) BioPerl installed on my own (old) machine and verified that the problem existed. I also tried to hunt down the cause.

    One possibility that was muted for this was the use of $`, $& or $'. Although I suggested to the OP that he try Devel::SawAmpersand, there was no follow up, so I hacked my way to installing Bio::SeqIO::fasta and all the required support packages, manually. (The full package has never installed for me.) I didn't detect that particular problem, but saw the machinations the module went through (back then; I see quite a lot of it is now commented out), to read a text file, and attributed the (at that point, quite extreme) slowness to that. I also attempted to track the module changes for a while, but that went out the window when I got my current machine.

    Long story short, when the OP reports "half an hour" for 200MB, that fit with my prior experiences, and I took him at his word. As your reply in that thread was not to me, I probably never saw it. So, if you are responsible for the performance improvements in the module, I congratulate you.

    All of that said, performance was only one of the issues I raised above.


    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://870111]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others rifling through the Monastery: (12)
As of 2015-07-03 07:02 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (48 votes), past polls