Beefy Boxes and Bandwidth Generously Provided by pair Networks
Your skill will accomplish
what the force of many cannot
 
PerlMonks  

Re: Writing a simple RSS aggregator.

by thraxil (Prior)
on Dec 06, 2003 at 02:50 UTC ( #312716=note: print w/replies, xml ) Need Help??


in reply to Writing a simple RSS aggregator.

also, aside from parsing issues, i'd like to point out that an RSS aggregator is an HTTP client and should be polite by properly supporting HTTP response codes and using things like Etags and If-Modified-Since headers to not overload the server (especially when it's mine ;)

for my RSS gathering and parsing, i actually prefer to use Mark Pilgrim's ultra-liberal feed parser, since he's even more anal about that stuff than i am. it doesn't require anything beyond the *cough* python core library, so if the server has python installed, that may be an option...

Replies are listed 'Best First'.
Re: Re: Writing a simple RSS aggregator.
by Koschei (Monk) on Dec 06, 2003 at 04:53 UTC

    Incidentally, Spidering hacks has Perl code for doing all the friendly etag, if-modified-since stuff. Which at some point I'll be building into WWW::Mechanize::Cached, along with Expires awareness.

Log In?
Username:
Password:

What's my password?
Create A New User
Node Status?
node history
Node Type: note [id://312716]
help
Chatterbox?
[Corion]: hippo: Yes, but I'm not sure that it's even worth the effort of implementing it at all...
[Corion]: You'll only ever need that option if you have a long-running query whose results are not cached by your DB already, and in those cases I presume that the programmer will want to maintain the temporary tables themselves - I wouldn't know when to drop ...
[Corion]: ... the temporary tables, and also don't have a good idea on how to create unique table names for them
[hippo]: OIC. In that case leave it out but invite feature requests and see if any of the users suggest it. :-)
[Corion]: Talking about this makes me realize that it's likely only a half useful idea. But it still would be convenient to have as an option...
[Corion]: hippo: Hmmm - yeah, I could document it and wait for code implementing that option to show up ;-D

How do I use this? | Other CB clients
Other Users?
Others avoiding work at the Monastery: (11)
As of 2017-02-23 15:36 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?
    Before electricity was invented, what was the Electric Eel called?






    Results (347 votes). Check out past polls.