Beefy Boxes and Bandwidth Generously Provided by pair Networks
good chemistry is complicated,
and a little bit messy -LW
 
PerlMonks  

Re: I need speed...

by kbeen (Sexton)
on Oct 07, 2001 at 10:39 UTC ( [id://117286]=note: print w/replies, xml ) Need Help??


in reply to I need speed...

A follow-up question...
The way the script is above, in order to confirm the legality of using each result, I am downloading HTML from the partner company and chacking it or each result. This is happening one at a time. How do I NOT wait until the previous result is checked before checking the next one... connect for each result at the same time(or almost the same time)?...

Kbeen

Replies are listed 'Best First'.
Re: Re: I need speed...
by tstock (Curate) on Oct 07, 2001 at 11:20 UTC
    Just be carefull with not pounding the other servers with more requests than what it can handle.

    I would say a Dual Pentium III 1000MHz can probably handle 50 hits per second as a top limit before active connections may start to accumulate, and eventually refuse new connections. This of course varies according to several factors, but it's probably a good gauge for a server running Apache on BSD or Linux.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://117286]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others having a coffee break in the Monastery: (4)
As of 2024-04-26 00:13 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found