Beefy Boxes and Bandwidth Generously Provided by pair Networks
The stupid question is the question not asked

Re: Faster Method for Gathering Data

by dga (Hermit)
on Jul 31, 2003 at 17:27 UTC ( #279670=note: print w/replies, xml ) Need Help??

in reply to Faster Method for Gathering Data

Another possibility which may not apply in your situation is to run a straight recursive directory listing into a text file then write a perl script to parse that.

The fastest of course would be to run the listing on the remote machine and then transfer the listing file to the local machine.

Second fastest might be to do the listing over the network and save the output locally and run a parsing script on that. Of course if an over the network directory listing takes 5 hours to complete you don't save a lot of time.

use strict; while(<>) { push(@files) if /\.sgml$/; }

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://279670]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others avoiding work at the Monastery: (3)
As of 2021-06-18 05:52 GMT
Find Nodes?
    Voting Booth?
    What does the "s" stand for in "perls"? (Whence perls)

    Results (88 votes). Check out past polls.