Beefy Boxes and Bandwidth Generously Provided by pair Networks
We don't bite newbies here... much

Re: 2000 cURL Request

by talexb (Canon)
on Aug 24, 2013 at 15:57 UTC ( #1050819=note: print w/ replies, xml ) Need Help??

in reply to 2000 cURL Request

Ideally, the way you should do this is start a relationship with the web site's API, which, when asked nicely, would tell you when a particular user was most recently changed (assuming you're looking for updates to that user).

Once you had that information, you'd be able to get details on just the users that were changed, saving you and the web server lots of wasted cycles.

Alex / talexb / Toronto

"Groklaw is the open-source mentality applied to legal research" ~ Linus Torvalds

Comment on Re: 2000 cURL Request

Log In?

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://1050819]
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others about the Monastery: (5)
As of 2016-04-30 11:32 GMT
Find Nodes?
    Voting Booth?
    :nehw tseb si esrever ni gnitirW

    Results (441 votes). Check out past polls.