Re^3: Processing large file using threads

in reply to Re^2: Processing large file using threads
in thread Processing large file using threads

Just a hunch, but...

Is this line

    my ($host)=GetHost($url);
[download]

doing any DNS-ish stuff ? If so, I'd suspect that's your bottleneck, and you'll need to look into a smarter hostname cache solution. Threads will help, but probably not as much as you'd hope.

Perl Contrarian & SQL fanboy

Comment on Re^3: Processing large file using threads Download Code

In Section Seekers of Perl Wisdom