Beefy Boxes and Bandwidth Generously Provided by pair Networks
No such thing as a small change

Re: 2000 cURL Request

by talexb (Canon)
on Aug 24, 2013 at 15:57 UTC ( #1050819=note: print w/ replies, xml ) Need Help??

in reply to 2000 cURL Request

Ideally, the way you should do this is start a relationship with the web site's API, which, when asked nicely, would tell you when a particular user was most recently changed (assuming you're looking for updates to that user).

Once you had that information, you'd be able to get details on just the users that were changed, saving you and the web server lots of wasted cycles.

Alex / talexb / Toronto

"Groklaw is the open-source mentality applied to legal research" ~ Linus Torvalds

Comment on Re: 2000 cURL Request

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1050819]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others rifling through the Monastery: (6)
As of 2015-11-28 14:50 GMT
Find Nodes?
    Voting Booth?

    What would be the most significant thing to happen if a rope (or wire) tied the Earth and the Moon together?

    Results (742 votes), past polls