Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer

Re: join on 6 huge files

by dba (Monk)
on Jun 10, 2004 at 14:06 UTC ( #363077=note: print w/replies, xml ) Need Help??

in reply to join on 6 huge files

unix utilities sort and join should do the work for you. Are the rows in each file unique and sorted? Depending on requirement use sort with  -u option. You may want to check out  -y option too.

Replies are listed 'Best First'.
Re^2: join on 6 huge files
by pbeckingham (Parson) on Jun 10, 2004 at 18:23 UTC

    Absolutely right. Doing this in Perl would be a waste of time if this is a one-off, and if there is no prior or subsequent processing. The only value is in implementing a merge sort, which is good practise I suppose.

    For Perl to sort, it first must slurp. The question of whether the input is already sorted therefore matters greatly.

    But our OP is absent, and hasn't responded to any questions. So given our lack of information, I agree with dba.

Log In?

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://363077]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others having an uproarious good time at the Monastery: (2)
As of 2021-09-28 05:37 GMT
Find Nodes?
    Voting Booth?

    No recent polls found