I am is sure nothing in the standard codebase of Wayback to attribute to this behavior.
I am asking wayback team if they have proxy server on top of wayback with special logic which is causing the 302 to be cachable for aproximate 10 minutes. The resulting responces are incorrect, so I try to understand if any reason exists for the wayback team to cache them.
________________________________
From: Jackson, Andrew [And...@bl...]
Sent: Wednesday, February 06, 2013 3:18 AM
To: Balakireva, Lyudmila; arc...@li...
Subject: RE: [Archive-access-discuss] (no subject)
Hi,
I don’t really understand this. The HTTP spec. you quote appears to state that the *client* should not cache the response. The *server* is surely free to cache whatever it wants? The X-Page-Cache header is surely just the accidental exposure of an implementation detail?
Anyway, this X-Page-Cache header does not seem to be coming from Wayback itself, or at least I couldn’t find any mention of such a header in the codebase. My guess would be that Tengine/1.3.0 is generating it, whatever that is.
Best wishes,
Andy Jackson
From: Balakireva, Lyudmila [mailto:lu...@la...]
Sent: 05 February 2013 18:56
To: arc...@li...
Subject: [Archive-access-discuss] (no subject)
Hello,
we noticed that HTTP 302 responses from wayback are cached, which is contradicts the
HTTP protocol 2616:
10.3.3 302 Found
The requested resource resides temporarily under a different URI.
Since the redirection might be altered on occasion, the client SHOULD
continue to use the Request-URI for future requests. This response
is only cacheable if indicated by a Cache-Control or Expires header
field.
perhaps there is a response from the IA server to squid that allows the caching and we're not seeing it?
As you can see from example below, the timegate responses (302s) are *too* cachable.
curl -I -H Accept-Datetime:"Wed, 29 Sep 2011 12:00:04 GMT" http://api.wayback.archive.org/memento/timegate/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/timegate/http:/www.beautifulkerala.com/>
HTTP/1.1 302 Moved Temporarily
Server: Tengine/1.3.0
Date: Tue, 05 Feb 2013 18:48:18 GMT
Content-Type: text/html
Connection: keep-alive
set-cookie: wayback_server=40; Domain=archive.org; Path=/; Expires=Thu, 07-Mar-13 18:48:18 GMT;
Vary: negotiate,accept-datetime
Link: <http://api.wayback.archive.org/list/timebundle/http://www.beautifulkerala.com/<http://api.wayback.archive.org/list/timebundle/http:/www.beautifulkerala.com/>>;rel="timebundle", <http://www.beautifulkerala.com/>;rel="original",<http://api.wayback.archive.org/memento/20110925033809/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20110925033809/http:/www.beautifulkerala.com/>>;rel="memento";datetime="Sun, 25 Sep 2011 03:38:09 GMT", <http://api.wayback.archive.org/memento/20120721041735/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20120721041735/http:/www.beautifulkerala.com/>>;rel="last memento"; datetime="Sat, 21 Jul 2012 04:17:35 GMT", <http://api.wayback.archive.org/memento/20030425003640/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20030425003640/http:/www.beautifulkerala.com/>>;rel="first memento"; datetime="Fri, 25 Apr 2003 00:36:40 GMT", <http://api.wayback.archive.org/memento/20110901203020/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20110901203020/http:/www.beautifulkerala.com/>>;rel="prev memento"; datetime="Thu, 01 Sep 2011 20:30:20 GMT", <http://api.wayback.archive.org/memento/20111025114541/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20111025114541/http:/www.beautifulkerala.com/>>;rel="next "; datetime="Tue, 25 Oct 2011 11:45:41 GMT" , <http://api.wayback.archive.org/list/timemap/link/http://www.beautifulkerala.com/<http://api.wayback.archive.org/list/timemap/link/http:/www.beautifulkerala.com/>>;rel="timemap"; type="application/link-format"
Location: http://api.wayback.archive.org/memento/20110925033809/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20110925033809/http:/www.beautifulkerala.com/>
Content-Length: 0
X-Page-Cache: MISS
[ludab@megalodon ~]$ curl -I -H Accept-Datetime:"Wed, 29 Sep 2011 12:00:04 GMT" http://api.wayback.archive.org/memento/timegate/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/timegate/http:/www.beautifulkerala.com/>
HTTP/1.1 302 Moved Temporarily
Server: Tengine/1.3.0
Date: Tue, 05 Feb 2013 18:48:21 GMT
Content-Type: text/html
Connection: keep-alive
set-cookie: wayback_server=40; Domain=archive.org; Path=/; Expires=Thu, 07-Mar-13 18:48:21 GMT;
Vary: negotiate,accept-datetime
Link: <http://api.wayback.archive.org/list/timebundle/http://www.beautifulkerala.com/<http://api.wayback.archive.org/list/timebundle/http:/www.beautifulkerala.com/>>;rel="timebundle", <http://www.beautifulkerala.com/>;rel="original",<http://api.wayback.archive.org/memento/20110925033809/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20110925033809/http:/www.beautifulkerala.com/>>;rel="memento";datetime="Sun, 25 Sep 2011 03:38:09 GMT", <http://api.wayback.archive.org/memento/20120721041735/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20120721041735/http:/www.beautifulkerala.com/>>;rel="last memento"; datetime="Sat, 21 Jul 2012 04:17:35 GMT", <http://api.wayback.archive.org/memento/20030425003640/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20030425003640/http:/www.beautifulkerala.com/>>;rel="first memento"; datetime="Fri, 25 Apr 2003 00:36:40 GMT", <http://api.wayback.archive.org/memento/20110901203020/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20110901203020/http:/www.beautifulkerala.com/>>;rel="prev memento"; datetime="Thu, 01 Sep 2011 20:30:20 GMT", <http://api.wayback.archive.org/memento/20111025114541/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20111025114541/http:/www.beautifulkerala.com/>>;rel="next "; datetime="Tue, 25 Oct 2011 11:45:41 GMT" , <http://api.wayback.archive.org/list/timemap/link/http://www.beautifulkerala.com/<http://api.wayback.archive.org/list/timemap/link/http:/www.beautifulkerala.com/>>;rel="timemap"; type="application/link-format"
Location: http://api.wayback.archive.org/memento/20110925033809/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20110925033809/http:/www.beautifulkerala.com/>
Content-Length: 0
X-Page-Cache: HIT
[ludab@megalodon ~]$ curl -I -H Accept-Datetime:"Wed, 29 Sep 2012 12:00:04 GMT" http://api.wayback.archive.org/memento/timegate/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/timegate/http:/www.beautifulkerala.com/>
HTTP/1.1 302 Moved Temporarily
Server: Tengine/1.3.0
Date: Tue, 05 Feb 2013 18:48:36 GMT
Content-Type: text/html
Connection: keep-alive
set-cookie: wayback_server=40; Domain=archive.org; Path=/; Expires=Thu, 07-Mar-13 18:48:36 GMT;
Vary: negotiate,accept-datetime
Link: <http://api.wayback.archive.org/list/timebundle/http://www.beautifulkerala.com/<http://api.wayback.archive.org/list/timebundle/http:/www.beautifulkerala.com/>>;rel="timebundle", <http://www.beautifulkerala.com/>;rel="original",<http://api.wayback.archive.org/memento/20110925033809/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20110925033809/http:/www.beautifulkerala.com/>>;rel="memento";datetime="Sun, 25 Sep 2011 03:38:09 GMT", <http://api.wayback.archive.org/memento/20120721041735/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20120721041735/http:/www.beautifulkerala.com/>>;rel="last memento"; datetime="Sat, 21 Jul 2012 04:17:35 GMT", <http://api.wayback.archive.org/memento/20030425003640/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20030425003640/http:/www.beautifulkerala.com/>>;rel="first memento"; datetime="Fri, 25 Apr 2003 00:36:40 GMT", <http://api.wayback.archive.org/memento/20110901203020/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20110901203020/http:/www.beautifulkerala.com/>>;rel="prev memento"; datetime="Thu, 01 Sep 2011 20:30:20 GMT", <http://api.wayback.archive.org/memento/20111025114541/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20111025114541/http:/www.beautifulkerala.com/>>;rel="next "; datetime="Tue, 25 Oct 2011 11:45:41 GMT" , <http://api.wayback.archive.org/list/timemap/link/http://www.beautifulkerala.com/<http://api.wayback.archive.org/list/timemap/link/http:/www.beautifulkerala.com/>>;rel="timemap"; type="application/link-format"
Location: http://api.wayback.archive.org/memento/20110925033809/http://www.beautifulkerala.com/<http://api.wayback.archive.org/memento/20110925033809/http:/www.beautifulkerala.com/>
Content-Length: 0
X-Page-Cache: HIT
|
