Beefy Boxes and Bandwidth Generously Provided by pair Networks
XP is just a number

Re^2: Searching for files efficiently help!

by Anonymous Monk
on Nov 16, 2011 at 20:23 UTC ( #938462=note: print w/replies, xml ) Need Help??

in reply to Re: Searching for files efficiently help!
in thread Searching for files efficiently help!

The directory where the search will start has about 10GB of files in it, do you think that this code will be efficient enough to handle such a directory size?
  • Comment on Re^2: Searching for files efficiently help!

Replies are listed 'Best First'.
Re^3: Searching for files efficiently help!
by aaron_baugher (Curate) on Nov 16, 2011 at 22:22 UTC

    There would seem to be two ways you can do this (but see correction below):

    1. Go through your array, deleting each file name if it exists as a file, or
    2. Go through your directory structure, checking each filename/path against your array (after turning it into a hash), and deleting it if it exists in the hash.

    Generally, I would prefer the first method. It's almost certain to be faster to go through a list of files and check for their existence than to traverse an entire directory structure and check every file against a list. If you simply go through your array, checking for the existence of each pathname and deleting if it's found, then it doesn't matter how large or complex your directory structure is.

    for my $file (@files){ if( -f $file ){ report($file); # however you want to report a match if( unlink $file ){ print "Deleted $file\n"; } else { warn "Unable to delete $file\n"; } } }

    Correction: As Jethro pointed out, I misunderstood the original requirements, getting the two arrays he mentioned mixed up. The array he wants to check the files against does not have full path names, so my solution won't work. He will have to recurse through the directory structure and check them one by one.

    Aaron B.
    My Woefully Neglected Blog, where I occasionally mention Perl.

      Your script would only work if the filenames he is looking for came with complete path. Seems not to be the case

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://938462]
and all is quiet...

How do I use this? | Other CB clients
Other Users?
Others avoiding work at the Monastery: (3)
As of 2018-03-20 07:09 GMT
Find Nodes?
    Voting Booth?
    When I think of a mole I think of:

    Results (248 votes). Check out past polls.