Re: Efficient deletion of files / shell interaction

[kyle]

in reply to Efficient deletion of files / shell interaction

I might write this, if I didn't care if anyone can read it.

my @job_nums = 0 .. $jobs_run;
my $logs = join q{ }, map { sprintf "$prefix%04d.log" } @job_nums;
my $tail_rx = qr{
    ==> (.+?) <== \n
    ( [^\n]* )    \n
}xms;

my @tail_pairs = `tail -n 1 $logs` =~ $tail_rx;
unlink map { s/\.log$/.data/; $_ }
       map { $tail_pairs[$_*2] }
      grep { $tail_pairs[1+$_*2] !~ /Normal/ } @job_nums;

Note that I haven't tried this, and given that it calls unlink, one would do well to test it with a copy of real data before trying it with real data.

This has the advantages that it shells out to run tail only once on the list of every log file and that it calls unlink only once with the list of the files to delete. On the other hand, the heavy use of map and grep means it does more looping than is absolutely necessary.