Beefy Boxes and Bandwidth Generously Provided by pair Networks
Perl-Sensitive Sunglasses
 
PerlMonks  

Re: Jabber RSS Reader

by thraxil (Prior)
on Jun 10, 2004 at 15:31 UTC ( #363107=note: print w/ replies, xml ) Need Help??


in reply to Jabber RSS Reader

the Jabber stuff is pretty neat, but you've written a very rude RSS aggregator.

you appear to be fetching the entire feed every single time without taking advantage of things like Etags and If-Modified-Since headers.

you could improve things significantly by making use of LWP's mirror() instead of get(). that will handle conditional requests for you automatically.

it's also a good idea to make sure you support all the HTTP return codes properly.

and fetching feeds every 5 minutes is way too frequent. some sites, like slashdot, will ban your reader if it hits them more often than once per hour.


Comment on Re: Jabber RSS Reader

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://363107]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others studying the Monastery: (16)
As of 2015-07-03 08:17 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    The top three priorities of my open tasks are (in descending order of likelihood to be worked on) ...









    Results (49 votes), past polls