Beefy Boxes and Bandwidth Generously Provided by pair Networks
Problems? Is your data what you think it is?

Re: Split file into 4 smaller ones

by BrowserUk (Pope)
on Feb 08, 2013 at 00:42 UTC ( #1017738=note: print w/ replies, xml ) Need Help??

in reply to Split file into 4 smaller ones

This will create output files split1 through split4. They will vary slightly in size in order that each file contains complete lines. The memory usage is minimal:

#! perl -sw use strict; open I, '<', $ARGV[0] or die $!; seek I, 0, 2; my $n = int( tell( I ) / 4 ); seek I, 0, 0; my $s = $n; for my $i ( 1 .. 4 ) { open O, '>', "split$i" or die $!; while( tell( I ) < $s ) { print O scalar <I>; } $s += $n; close O; } __END__ C:\test>dir words.txt 17/07/2011 15:52 1,941,858 words.txt C:\test>split4 words.txt C:\test>dir split* 08/02/2013 00:41 485,470 split1 08/02/2013 00:41 485,458 split2 08/02/2013 00:41 485,468 split3 08/02/2013 00:41 485,462 split4 08/02/2013 00:38 298

With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
Comment on Re: Split file into 4 smaller ones
Download Code

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1017738]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (10)
As of 2016-05-25 08:43 GMT
Find Nodes?
    Voting Booth?