With regards to the bottleneck, I don't think this will be a problem. I'm not writing a web crawler, this is just something to automate a bunch of form post requests, and massage the data I get back. But that doesn't matter for getting the threading part right.
I will eventually be storing stuff in mysql, but this is a future PM question....
|Replies are listed 'Best First'.|
Re^5: What is the fastest way to download a bunch of web pages?
by Anonymous Monk on Mar 03, 2005 at 15:09 UTC