Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

Re: Linux sort or FILE::SORT

by Utilitarian (Vicar)
on Feb 08, 2011 at 10:42 UTC ( [id://886917]=note: print w/replies, xml ) Need Help??


in reply to Linux sort or FILE::SORT

The sort utility in the shell is a C program optimised for sorting, it will always be faster than loading Perl and calling a module, regardless of the efficiency of the module (assuming someone doesn't come up with a spectacularly fast new sort algorithm ;)

print "Good ",qw(night morning afternoon evening)[(localtime)[2]/6]," fellow monks."

Replies are listed 'Best First'.
Re^2: Linux sort or FILE::SORT
by BrowserUk (Patriarch) on Feb 08, 2011 at 11:04 UTC

    It is actually quite easy to beat gnusort for performance.

    Firstly it uses miniscule buffers relative to modern memory sizes necessitating far more write read cycles than could ever be optimum.

    Secondly, with most machines having multiple cores these days, it is silly not to utilise them.

    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.
[reply]
      It does take the -S $BUFFER_SIZE flag.

      Are sort operations usually CPU bound?

      print "Good ",qw(night morning afternoon evening)[(localtime)[2]/6]," fellow monks."
[reply]
[d/l]
        It does take the -S $BUFFER_SIZE flag.

        I guess you must have a later version of gnu sort than I? 

        C:\test>sort --version
sort (GNU textutils) 2.0
Written by Mike Haertel.

        [download]
        Are sort operations usually CPU bound?

        The in-memory sort stages certainly are. If you overlap the sorting of one batch with the reading of the second, you save some time.

        Have one thread reading/or writing and 1/3/7/15/... threads sorting, you save more time.

        Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
        "Science is about questioning the status quo. Questioning authority".
        In the absence of evidence, opinion is indistinguishable from prejudice.
[reply]
[d/l]

In Section Seekers of Perl Wisdom

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?

www.com | www.net | www.org
Node Status?
node history
Node Type: note [id://886917]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? • Last hour • Other CB clients
Other Users?
Others studying the Monastery: (2)
As of 2026-03-06 20:40 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found
    Notices?
    • hippo‥ epoptai's answer Re: how do I set a cookie and redirect was blessed by hippo!
    • erzuuli‥ Anonymous Monks are no longer allowed to use Super Search, due to an excessive use of this resource by robots.