P is for Practical | |
PerlMonks |
Re^2: How to speed up my Html parsing program? (Concurrently run Subroutines?)by eye (Chaplain) |
on Jan 06, 2009 at 07:37 UTC ( [id://734361]=note: print w/replies, xml ) | Need Help?? |
This page contains a list of links which then need to be retrieved by the get_page_html() method and there content passed to retrieve_info();If the get_page_html() method retrieves pages over a network (rather than from disk), there is great potential for improving performance with forking or threads. In a single process/thread, network latency is additive. With multiple processes/threads, latency costs can run concurrently.
In Section
Seekers of Perl Wisdom
|
|