Re: [Archive-access-discuss] FW: Wayback 0.8.0 and ArcProxy

[Erik H. <eri...@uc...>]

Hi Jackson,

At Thu, 10 Jan 2008 13:29:05 -0000,
"Pope, Jackson" <Jac...@bl...> wrote:
>=20
> Hiya,
>=20
> Are there any instructions on how to setup an ArcProxy for use with
> Wayback 0.8.0?

Unfortunately the docs on the web site are for the 1.0 series of
Wayback. It=E2=80=99s been a while since I set up an arc proxy for the 0.8
series but I=E2=80=99ll do my best.
=20
> I've got wayback installed and working with Nutchwax, and
> now I'm trying to get the arcs proxied rather than use the
> LocalRestoreStore. I want the ArcProxy setup on the same machine, and
> the files presented via HTTP on the same machine too (though they are
> stored on an NFS server).

If you only have one set of files served via HTTP, I am not sure you
need the proxy. You should be able to get away with just an HTTP
resource store; the proxy is only necessary if you have many HTTP
servers serving ARC content, and you need a central location to keep
track of where ARCs are located.

> I've uncommented the appropriate section of the web.xml, and tryied
> running location-client, but I'm not sure I've got an ArcProxy running
> (is it a separate download or part of Wayback?), and I don't know what
> setting to use in the location-client calls or the Remote HTTP1.1
> Resource Store, to get this setup correctly. Is there a document kicking
> around that explains this?

If you have got an arc proxy working correctly, and you have added to
it with the location client, you should be able to do a GET on
http://example.org/proxy-prefix/IAH-20070705232355-00000-example.org.arc.gz
for a known ARC to get it back.

I find it easier to use the following curl command to add ARCs to the
arc proxy than using the location-client:

curl ${LOCATIONDB_URL} -d operation=3Dadd -d name=3D${F} -d url=3D${BASE_UR=
L}${F}

where LOCATIONDB_URL is the arc proxy URL, F is the name of the arc
file, and BASE_URL is the base url of the HTTP server where you are
serving arc files from.

Hope that helps.

best,
Erik Hetzner
;; Erik Hetzner, California Digital Library
;; gnupg key id: 1024D/01DB07E3