Re: Testing proxy "health"

[gamache]

I once dealt with this problem by giving each proxy N chances to fail, and after one reached N failures, I'd remove it from the list. It was a pound of cure rather than an ounce of prevention, but it more or less did the job. This method was used in a program where I was hitting 60-100 proxies at a time, so having a few not working at any given moment wasn't of high importance as long as things settled out eventually.

[hacker]

Can you explain to me how you were able to "kill" the running process trying to reach a dead, down, unavailable proxy?

I've tried this, and once I attempt to access content via a down proxy in my array, I have to sit and wait until that proxy times out, before I can try again.

I'm not sure how to capture that "downed" state, kill the process attempting to use that proxy, and then loop across another proxy until I find one that works.

[andyford]

What about just setting a shorter timeout?

[gamache]

Bingo, this is what I did.