Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number
 
PerlMonks  

Re^2: Finding and sorting files in massive file directory

by CColin (Scribe)
on Jan 20, 2013 at 21:30 UTC ( #1014339=note: print w/ replies, xml ) Need Help??


in reply to Re: Finding and sorting files in massive file directory
in thread Finding and sorting files in massive file directory

Seem to recall when I tried something like this it failed due to too many arguments being passed to the command. ie. you can't run a million or so files through gzip command?


Comment on Re^2: Finding and sorting files in massive file directory
Re^3: Finding and sorting files in massive file directory
by frozenwithjoy (Curate) on Jan 21, 2013 at 01:04 UTC
    If you put something like this in a while (there are files that start w/ a) loop, you should get around the issue of too many arguments. (Be sure to set increment=1 before the loop).
    mkdir dir_a.$increment mv `ls a* | head -n1000` dir_a.$increment/ let increment++
      The problem is you will get "too many arguments" from ls a* already.
      لսႽ ᥲᥒ⚪⟊Ⴙᘓᖇ Ꮅᘓᖇ⎱ Ⴙᥲ𝇋ƙᘓᖇ
Re^3: Finding and sorting files in massive file directory
by MidLifeXis (Prior) on Jan 21, 2013 at 13:12 UTC

    See the xargs command. It can help with breaking apart large command lines.

    find . -type f -name b\* -depth -2 | xargs $command_that_can_be_run_mu +ltiple_times

    Update: added example.

    --MidLifeXis

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1014339]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others examining the Monastery: (9)
As of 2014-07-25 13:39 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite superfluous repetitious redundant duplicative phrase is:









    Results (171 votes), past polls