Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re: Re: Filesystem: How to grab subset of directory structure

by P0w3rK!d (Pilgrim)
on Jun 25, 2003 at 18:48 UTC ( #268948=note: print w/replies, xml ) Need Help??


in reply to Re: Filesystem: How to grab subset of directory structure
in thread Filesystem: How to grab subset of directory structure

In this version of the application the producer is sending me the files and dumping them into one directory. Version 2.0 will use subdirectories.

The problem is, that even with subdirectories, when the consumer (my code) cannot send files to a remote FTP site (server is down or whatever) the files will queue up. Hence, I am getting tens of thousands of files. Just last weekend the FTP server was down and 35,000 XML files were queued up. Even with subdirectories the problem still remains.

Thank you for your reply :)

-P0w3rK!d

  • Comment on Re: Re: Filesystem: How to grab subset of directory structure

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://268948]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others pondering the Monastery: (4)
As of 2019-12-07 19:35 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Strict and warnings: which comes first?



    Results (162 votes). Check out past polls.

    Notices?