Re: [Archive-access-discuss] FW: Wayback 0.8.0 and ArcProxy

[Pope, J. <Jac...@bl...>]

Hiya Erik,

Thanks for all your help. I'd already got it working - I needed to make
the arcs files accessible via Apache - that fixed all the problems.

Cheers,

Jack

Jackson Pope
Technical Lead
Web Archiving Team
The British Library
+44 (0)1937 54 6942

-----Original Message-----
From: Erik Hetzner [mailto:eri...@uc...]=20
Sent: 11 January 2008 16:02
To: arc...@li...
Cc: Pope, Jackson
Subject: Re: [Archive-access-discuss] FW: Wayback 0.8.0 and ArcProxy

At Fri, 11 Jan 2008 11:10:41 -0000,
"Pope, Jackson" <Jac...@bl...> wrote:
>=20
> Hiya Erik,
>=20
> Thanks for your help. I've now got an ArcProxy running (by copying
> wayback.war to arc-proxy.war, deploying the proxy and changing its
> config so only the ArcProxy/LocationDB section is not commented
> out), but I still can't see the files.
>=20
> I've run curl as you suggested and it appears to work (urls munged
> below):
> curl http://www.example.com:8080/arc-proxy/locationDB -d =
operation=3Dadd
> -d
>
name=3D/wap/filestore/2523139/arcs/IAH-20070920101741-00000-wap300.bl.uk.=
a
> rc.gz -d
>
url=3Dhttp://www.example.com:8080/arc-proxy/arcs/IAH-20070920101741-00000=
-
> wap300.bl.uk.arc.gz
> OK added url
>
http://www.example.com:8080/arc-proxy/arcs/IAH-20070920101741-00000-wap3
> 00.bl.uk.arc.gz for
>
/wap/filestore/2523139/arcs/IAH-20070920101741-00000-wap300.bl.uk.arc.gz
>=20
> Yet when I try to browse the wayback for a URL in that arc I get an
> error saying the resource is unavailable with the following error in
> catalina.out:
>
> INFO: initialized
org.archive.wayback.resourcestore.http.FileLocationDB
> com.sleepycat.je.DatabaseException: Unable to
> locate(IAH-20070920101741-00000-wap300.bl.uk.arc.gz)
> [...]
>=20
> It's not a problem with the arc file, as this was fine when I was
using
> a local ARC store.
>=20
> Any ideas?

Hi Jack.

I think that the problem might be that you are using the full path as
the name parameter. Can you try using just the ARC name as the name
parameter instead? For example:

curl http://www.example.com:8080/arc-proxy/locationDB -d operation=3Dadd
-d name=3DIAH-20070920101741-00000-wap300.bl.uk.arc.gz -d
url=3Dhttp://www.example.com:8080/arc-proxy/arcs/IAH-20070920101741-00000=
-
wap300.bl.uk.arc.gz

I believe that name is what arc-proxy uses as the lookup key, so it
makes sense that the proxy would be unable to locate
'IAH-20070920101741-00000-wap300.bl.uk.arc.gz': it knows that ARC as
/wap/filestore/...

best,
Erik Hetzner
;; Erik Hetzner, California Digital Library
;; gnupg key id: 1024D/01DB07E3

*************************************************************************=
*
=20
Experience the British Library online at www.bl.uk
=20
The British Library's new interactive Annual Report and Accounts 2006/07 =
: www.bl.uk/mylibrary
=20
Help the British Library conserve the world's knowledge. Adopt a Book. =
www.bl.uk/adoptabook
=20
The Library's St Pancras site is WiFi - enabled
=20
*************************************************************************=

=20
The information contained in this e-mail is confidential and may be =
legally privileged. It is intended for the addressee(s) only. If you are =
not the intended recipient, please delete this e-mail and notify the =
pos...@bl... : The contents of this e-mail must not be disclosed or =
copied without the sender's consent.=20
=20
The statements and opinions expressed in this message are those of the =
author and do not necessarily reflect those of the British Library. The =
British Library does not take any responsibility for the views of the =
author.=20
=20
*************************************************************************=