Beefy Boxes and Bandwidth Generously Provided by pair Networks
Pathologically Eclectic Rubbish Lister
 
PerlMonks  

Re: Jabber RSS Reader

by thraxil (Prior)
on Jun 10, 2004 at 15:31 UTC ( #363107=note: print w/ replies, xml ) Need Help??


in reply to Jabber RSS Reader

the Jabber stuff is pretty neat, but you've written a very rude RSS aggregator.

you appear to be fetching the entire feed every single time without taking advantage of things like Etags and If-Modified-Since headers.

you could improve things significantly by making use of LWP's mirror() instead of get(). that will handle conditional requests for you automatically.

it's also a good idea to make sure you support all the HTTP return codes properly.

and fetching feeds every 5 minutes is way too frequent. some sites, like slashdot, will ban your reader if it hits them more often than once per hour.


Comment on Re: Jabber RSS Reader

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://363107]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this? | Other CB clients
Other Users?
Others lurking in the Monastery: (4)
As of 2014-09-23 08:27 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    How do you remember the number of days in each month?











    Results (212 votes), past polls