Beefy Boxes and Bandwidth Generously Provided by pair Networks
good chemistry is complicated,
and a little bit messy -LW
 
PerlMonks  

Re^2: Speeding up/parallelizing hundreds of HEAD requests

by hacker (Priest)
on Sep 16, 2007 at 19:58 UTC ( #639291=note: print w/ replies, xml ) Need Help??


in reply to Re: Speeding up/parallelizing hundreds of HEAD requests
in thread Speeding up/parallelizing hundreds of HEAD requests

I must have missed something in your reply.. how exactly is a local shared memory cache on a mmap'd file, going to help me speed up external HEAD requests to dozens/hundreds of separate resources over HTTP?

For access to my templates and local files, sure, I can see how this would help (but so does Memoize, HTML::Template::Compiled, and so on), but I'm not sure where this helps speed up remote requests.


Comment on Re^2: Speeding up/parallelizing hundreds of HEAD requests
Re^3: Speeding up/parallelizing hundreds of HEAD requests
by perrin (Chancellor) on Sep 16, 2007 at 20:06 UTC
    You mentioned caching the requests instead of actually doing them every time. This is a good way to do that. It's more efficient than a bunch of database queries, and makes it very easy to control timeouts on the cache, in case you only want to check every 2 hours or so.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://639291]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others perusing the Monastery: (10)
As of 2014-09-02 18:12 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    My favorite cookbook is:










    Results (29 votes), past polls