|
|
|
| laziness, impatience, and hubris | |
| PerlMonks |
Re^2: AnyEvent Parallel HTTPby Corion (Patriarch) |
| on Feb 21, 2015 at 16:46 UTC ( [id://1117435]=note: print w/replies, xml ) | Need Help?? |
|
Uh - AnyEvent is a framework to do tasks in parallel that are not CPU bound. And usually, web scraping is not CPU bound. Distributing the load across more than one CPU makes sense if your load is CPU bound, but not necessarily when scraping a website over the network. There is no need to involve threads or forking when using AnyEvent.
In Section
Seekers of Perl Wisdom
|
|
||||||||||||||||||||||