Beefy Boxes and Bandwidth Generously Provided by pair Networks
good chemistry is complicated,
and a little bit messy -LW
 
PerlMonks  

Re^2: Finding and sorting files in massive file directory

by CColin (Scribe)
on Jan 20, 2013 at 21:30 UTC ( #1014339=note: print w/replies, xml ) Need Help??


in reply to Re: Finding and sorting files in massive file directory
in thread Finding and sorting files in massive file directory

Seem to recall when I tried something like this it failed due to too many arguments being passed to the command. ie. you can't run a million or so files through gzip command?
  • Comment on Re^2: Finding and sorting files in massive file directory

Replies are listed 'Best First'.
Re^3: Finding and sorting files in massive file directory
by frozenwithjoy (Priest) on Jan 21, 2013 at 01:04 UTC
    If you put something like this in a while (there are files that start w/ a) loop, you should get around the issue of too many arguments. (Be sure to set increment=1 before the loop).
    mkdir dir_a.$increment mv `ls a* | head -n1000` dir_a.$increment/ let increment++
      The problem is you will get "too many arguments" from ls a* already.
      لսႽ ᥲᥒ⚪⟊Ⴙᘓᖇ Ꮅᘓᖇ⎱ Ⴙᥲ𝇋ƙᘓᖇ
Re^3: Finding and sorting files in massive file directory
by MidLifeXis (Monsignor) on Jan 21, 2013 at 13:12 UTC

    See the xargs command. It can help with breaking apart large command lines.

    find . -type f -name b\* -depth -2 | xargs $command_that_can_be_run_mu +ltiple_times

    Update: added example.

    --MidLifeXis

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1014339]
help
Chatterbox?
[Wcool]: hi there
[Wcool]: Does anyone know how to assign STDOUT to a file var in perl6?
[choroba]: hey
[Wcool]: i.e. eequivalent of
[Wcool]: $fh_out = *STDOUT;

How do I use this? | Other CB clients
Other Users?
Others contemplating the Monastery: (12)
As of 2017-03-23 15:46 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Should Pluto Get Its Planethood Back?



    Results (289 votes). Check out past polls.