http://www.perlmonks.org?node_id=312716


in reply to Writing a simple RSS aggregator.

also, aside from parsing issues, i'd like to point out that an RSS aggregator is an HTTP client and should be polite by properly supporting HTTP response codes and using things like Etags and If-Modified-Since headers to not overload the server (especially when it's mine ;)

for my RSS gathering and parsing, i actually prefer to use Mark Pilgrim's ultra-liberal feed parser, since he's even more anal about that stuff than i am. it doesn't require anything beyond the *cough* python core library, so if the server has python installed, that may be an option...

Replies are listed 'Best First'.
Re: Re: Writing a simple RSS aggregator.
by Koschei (Monk) on Dec 06, 2003 at 04:53 UTC

    Incidentally, Spidering hacks has Perl code for doing all the friendly etag, if-modified-since stuff. Which at some point I'll be building into WWW::Mechanize::Cached, along with Expires awareness.