Aww, knock it off, willya? You’re just being a pest. If you care to, why don’t you argue the opposite case? Demonstrate for your fellow Monks, who I am sure will be quite interested, how throwing 500 threads at this problem is justifiable and necessary. Otherwise, good sir, please mind your own business. Snarking the threads of fellow Monks just because you don’t happen to agree with them does not win you the XP that you seem to crave. Good day to you.
| [reply] |
I knew you wouldn't. Because you obviously don't know how.
Demonstrate for your fellow Monks,
I already did 500+ times.
Meanwhile a search for your threaded code contributions turns up one hit. And there's no code in that either.
how throwing 500 threads at this problem is justifiable and necessary.
Simple math. You have 2000 SaaS servers from which to retrieve data, that takes them 10 seconds to prepare and return.
Using 4 threads: 2000*10/4 = 5000 seconds = 1hr 23 minutes elapsed.
Using 100 threads: 2000*10/100 = 200 seconds = 3.3 minutes elapsed.
Using 500 threads: 2000*10/500 = 40 seconds elapsed.
You need another demo?
[ 0:35:30.57] c:\test>t-head-urls -THREADS=4 urls.list
Processed 2040 urls
Took 424.354000 with 4 threads
c:\test>t-head-urls -THREADS=8 urls.list
Processed 2040 urls
Took 215.305000 with 8 threads
c:\test>t-head-urls -THREADS=16 urls.list
Processed 2040 urls
Took 123.232000 with 16 threads
c:\test>t-head-urls -THREADS=32 urls.list
Processed 2040 urls
Took 90.033000 with 32 threads
c:\test>t-head-urls -THREADS=64 urls.list
Processed 2040 urls
Took 88.804000 with 64 threads
You see where that's headed?
So now it is (way past) your turn. Ante up if you can.
With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
| [reply]
[d/l] |
Bumcombe!!
If I have, as you yourself have said, “2,000 SAAS servers from which to retrieve data, that takes each of them 10 seconds to prepare and return,” then I most-emphatically don’t require “an equal number of my processor threads to be sitting around, each of them waiting for one of those SAAS servers to answer me.“
If I am waiting to hear back from “2,000 SAAS servers,” then the one thing that I can absolutely count on is that: it will not be the case that all 2,000 of them will reply to me within precisely the same millisecond. There is, after all, one TCP/IP interface card on this box, therefore all of the datagrams will arrive one at a time. Many, many milliseconds apart. Therefore, it is entirely to be expected that just one process, on my end, will be able to handle the 2,000 separate responses that will arrive.
Y’know, BrowserUK, I am afraid that these days you spend so much time opposing what I have to say, on the assumption that during the course of 30 years in this business that I have learned absolutely nothing in the way of pragmatic and practical and worldly experience, that you seem to spend almost no time listening to whatever it is that I have to say. And maybe, (durst I say it?) you really ought to “meditate” on that, for a little-biddy while. It might just do you some good. Because, quite frankly, I do not have the time, nor do I have the slightest inclination, to quarrel with you further on these points.
Good day, sir.
| [reply] |
