Support for HTTP ETags (+ Other LWP Tricks)
Status: Beta
Brought to you by:
morbus
Menu
▾
▴
#7 Support for HTTP ETags (+ Other LWP Tricks)
Simon wrote: "Here's a suggestion for people writing
RSS aggregators, use the HTTP/1.1 Etag and If-None-
Match headers so that you only fetch the feed if its
changed."
implementation details at
http://www.pocketsoap.com/weblog/stories/2002/05/19/b
dgToEtags.html
Logged In: YES
user_id=69804
Already on the TODO list. Been there for a while.
AmphetaDesk currently examines HEADs, making it one of the
more bandwidth friendly aggregators already (that, and it
only scanning every three hours). Before I do implement
this, I want to get a feel for how many servers DON'T
support the tags, so I can see how much bandwidth is being
lost by full download each time.
Logged In: YES
user_id=69804
A heavily revised WWW.pm should be included in the next
release, hopefully. Most of the working code
(If-Modified-Since, ETags, gzipped content, HTTP
authentication, etc.) has been written and demonstrated in
my SPIDERING HACKS, it's just a matter of integrating it.
Note, however, HTTPS support is still up in the air. It's
easy for everything save Windows - Crypt::SSLeay requires
some OpenSSL libraries, and getting those installed on
Windows, and then shipped in a way that they'll work with
AmphetaDesk has yet to be researched.
Logged In: YES
user_id=69804
There's a PPD for Crypt::SSLeay at
http://theoryx5.uwinnipeg.ca/ppmpackages/.