http://www.perlmonks.org?node_id=436274


in reply to Re: What is the fastest way to download a bunch of web pages?
in thread What is the fastest way to download a bunch of web pages?

Sounds promising. Any open code to do this?
  • Comment on Re^2: What is the fastest way to download a bunch of web pages?

Replies are listed 'Best First'.
Re^3: What is the fastest way to download a bunch of web pages?
by merlyn (Sage) on Mar 03, 2005 at 17:47 UTC
Re^3: What is the fastest way to download a bunch of web pages?
by FitTrend (Pilgrim) on Mar 03, 2005 at 16:52 UTC

    If you're looking to control how many child processes, Parallel::ForkManager may be helpful. The example source specifically demonstrates what I think you're trying to accomplish.