In this version of the application the producer is sending me the files and dumping them into one directory. Version 2.0 will use subdirectories.
The problem is, that even with subdirectories, when the consumer (my code) cannot send files to a remote FTP site
(server is down or whatever) the files will queue up. Hence,
I am getting tens of thousands of files. Just last weekend
the FTP server was down and 35,000 XML files were queued up.
Even with subdirectories the problem still remains.
Thank you for your reply :)