Re: [VuFind-General] Searching catalogue and respository

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 454-5900

In your oai.ini, try replacing:

idSearch[] = "/oai:bbk.ac.uk.oai2:/"

with:

idSearch[] = "/oai:eprints.bbk.ac.uk.oai2:/"

- Demian

> -----Original Message-----
> From: Tim Fletcher [mailto:T.F...@bb...]
> Sent: Thursday, February 23, 2012 11:18 AM
> To: Demian Katz; vuf...@li...
> Subject: RE: Searching catalogue and respository
> 
> Apologies, trying again.
> 
> Tim
> 
> > -----Original Message-----
> > From: Demian Katz [mailto:dem...@vi...]
> > Sent: 23 February 2012 16:05
> > To: Tim Fletcher; vuf...@li...
> > Subject: RE: Searching catalogue and respository
> >
> > I didn't get the attachment -- do you mind resending that?
> >
> > thanks,
> > Demian
> >
> > > -----Original Message-----
> > > From: Tim Fletcher [mailto:T.F...@bb...]
> > > Sent: Thursday, February 23, 2012 11:04 AM
> > > To: Demian Katz; vuf...@li...
> > > Subject: RE: Searching catalogue and respository
> > >
> > > Hi Demian,
> > >
> > > Thanks again for the advice. I've tried editing oai.in and reloading
> > > everything, having deleted it all first, but am still getting the
> same
> > > error message.
> > >
> > > The relevant part of oai.ini looks like this:
> > > ; BIRON test
> > > [BIRON]
> > > url = http://eprints.bbk.ac.uk/cgi/oai2 metadataPrefix = oai_dc
> > > idSearch[] = "/oai:bbk.ac.uk.oai2:/"
> > > idReplace[] = "eprints-"
> > > idSearch[] = "/\//"
> > > idReplace[] = "-"
> > > injectId = "identifier"
> > > injectDate = "datestamp"
> > > dateGranularity = auto
> > > harvestedIdLog = harvest-biron.log
> > >
> > > I suspect I am missing something obvious here.
> > >
> > > I'm also attaching a sample harvested record from our repository in
> > > case that is of any help.
> > >
> > > Thanks again,
> > >
> > > Tim
> > >
> > >
> > > > -----Original Message-----
> > > > From: Demian Katz [mailto:dem...@vi...]
> > > > Sent: 22 February 2012 15:23
> > > > To: Tim Fletcher; vuf...@li...
> > > > Subject: RE: Searching catalogue and respository
> > > >
> > > > The problem here is that VuFind doesn't like IDs with colons in
> them.
> > > You
> > > > have two options:
> > > >
> > > > 1.) Use the idSearch[]/idReplace[] settings in oai.ini to strip
> out
> > > the
> > > > "oai:eprints.bbk.ac.uk.oai:" prefix (and possibly replace it with
> > > something
> > > > else).  i.e., you could do something like:
> > > >
> > > > idSearch[] = "/oai:eprints.bbk.ac.uk.oai:/"
> > > > idReplace[] = "eprints-"
> > > >
> > > > That should still give you unique IDs but protect you from
> > > > characters
> > > that will
> > > > cause VuFind to misbehave.  You'll just have to re-harvest and
> > > re-index.
> > > >
> > > > 2.) I very recently released some patches which help VuFind do a
> > > better job
> > > > of dealing with the colon situation; see
> > > > http://vufind.org/jira/browse/VUFIND-508 for details.  If you
> apply
> > > these
> > > > changes, you may solve the problem without the need to harvest and
> > > index
> > > > again.
> > > >
> > > > I'd recommend approach #1 over approach #2, though -- there are a
> > > > lot
> > > of
> > > > places where weird IDs might cause problems, and it's possible I
> > > haven't
> > > > fixed them all yet.  If there are no disadvantages to cleaning up
> > > > the
> > > IDs, then
> > > > you might as well do it and save yourself from subtle problems.
> > > >
> > > > Congratulations on making it this far, and let me know if you need
> > > > any
> > > more
> > > > help moving forward -- hopefully this will get you significantly
> > > further!
> > > >
> > > > - Demian
> > > >
> > > > > -----Original Message-----
> > > > > From: Tim Fletcher [mailto:T.F...@bb...]
> > > > > Sent: Wednesday, February 22, 2012 10:02 AM
> > > > > To: Demian Katz; vuf...@li...
> > > > > Subject: RE: Searching catalogue and respository
> > > > >
> > > > > Hi,
> > > > >
> > > > > Pleased to report some success. It looks like the Eprints format
> > > > > is pretty similar to the Dspace one so I just borrowed that to
> get
> > > going.
> > > > > The import appeared to work and a search for repository items
> gets
> > > the
> > > > > right number of hits. It's when I try to follow one of the hits
> > > > > that it gets a bit exciting as the following error is generated:
> > > > >
> > > > > An error has occurred
> > > > >
> > > > > Unable to process query
> > > > > Solr Returned: Query parsing error: Cannot parse
> > > > > 'id:oai:eprints.bbk.ac.uk.oai2:181': Encountered " ":" ": "" at
> > > > > line 1, column 6. Was expecting one of: <EOF> <AND> ... <OR> ...
> > > > > <NOT>
> > > ... "+"
> > > > > ... "-" ... "(" ... "*" ... "^" ... <QUOTED> ... <TERM> ...
> > > > > <FUZZY_SLOP> ... <PREFIXTERM> ... <WILDTERM> ... "[" ... "{" ...
> > > > <NUMBER> ...
> > > > >
> > > > > RequestURI=/solr/biblio/select/
> > > > >
> > > > > The link looks like
> > > > > http://mlib169/vufind/Record/oai:eprints.bbk.ac.uk.oai:A181
> > > > >
> > > > > I'm assuming that following one of the items in a list should
> take
> > > me
> > > > > to a full record so I'm guessing that I've got something wrong
> in
> > > how
> > > > > the link to the record is created. Any suggestions about where
> to
> > > > > start digging would be helpful. I am slightly amazed that I got
> > > > > this
> > > far!
> > > > >
> > > > > Thanks,
> > > > > Tim
> > > > >
> > > > > > -----Original Message-----
> > > > > > From: Tim Fletcher
> > > > > > Sent: 21 February 2012 16:33
> > > > > > To: 'Demian Katz'; vuf...@li...
> > > > > > Subject: RE: Searching catalogue and respository
> > > > > >
> > > > > > Hi Demian,
> > > > > >
> > > > > > Thanks - this makes sense, it all seemed a bit too easy! I
> will
> > > have
> > > > > > a
> > > > > stab at
> > > > > > this and then get in touch when I get stuck.
> > > > > >
> > > > > > Tim
> > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Demian Katz [mailto:dem...@vi...]
> > > > > > > Sent: 21 February 2012 15:09
> > > > > > > To: Tim Fletcher; vuf...@li...
> > > > > > > Subject: RE: Searching catalogue and respository
> > > > > > >
> > > > > > > The OAI harvest is a two-step process -- first you harvest
> the
> > > > > records
> > > > > > > to a directory, and then you need to import the files from
> > > > > > > that directory into the Solr index.  I'm guessing that you
> > > > > > > haven't
> > > done
> > > > > the
> > > > > > second step.
> > > > > > >
> > > > > > > There are some details here:
> > > > > > >
> > > > > > > http://vufind.org/wiki/importing_records#xml_records
> > > > > > >
> > > > > > > The hard part of this is that you need to set up an XSLT to
> > > > > transform
> > > > > > > your harvested records into documents that can be loaded
> into
> > > the
> > > > > Solr
> > > > > > > index.  I don't think we have an existing sample
> configuration
> > > for
> > > > > > > Eprints (though if somebody is already doing this, please
> > > > > > > speak up), so you may need to adapt one of the existing
> > > > > > > examples and make some changes to match the Eprints format.
> > > > > > > XSLT is not the easiest thing
> > > > > to
> > > > > > > work with, so feel free to ask questions if you need help.
> > > > > > > Also
> > > > > feel
> > > > > > > free to share a sample harvested record if you would like
> > > > > > recommendations on the best way to proceed.
> > > > > > >
> > > > > > > - Demian
> > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Tim Fletcher [mailto:T.F...@bb...]
> > > > > > > > Sent: Tuesday, February 21, 2012 9:40 AM
> > > > > > > > To: vuf...@li...
> > > > > > > > Subject: [VuFind-General] Searching catalogue and
> > > > > > > > respository
> > > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > We are making some good progress with a second test
> > > installation
> > > > > > > > - this time on Ubuntu - and although there are a lot of
> > > > > > > > things still to sort out I was tempted to try to see if I
> > > > > > > > could
> > > search
> > > > > > > > our Eprints institutional repository as well as the
> library
> > > catalogue.
> > > > > I
> > > > > > > > feel this would be a good selling point in trying to get
> > > support
> > > > > to
> > > > > > > > really work on an implementation.
> > > > > > > >
> > > > > > > > I edited OAI.INI and seem to have harvested the records
> from
> > > our
> > > > > > > > repository but nothing appears when I try to do a search.
> > > > > > > > I'm just wondering if what I want to do is possible or if
> I
> > > > > > > > am missing something and there is a setting that needs
> amending.
> > > > > > > > Any advice welcome - even if it is to tell me that this
> > > > > > > > isn't
> > > possible!
> > > > > > > >
> > > > > > > > Many thanks,
> > > > > > > >
> > > > > > > > Tim
> > > > > > > > -----------------------
> > > > > > > > Tim Fletcher
> > > > > > > >
> > > > > > > > Library IT Development Manager Birkbeck College University
> > > > > > > > of London Malet Street London WC1E 7HX
> > > > > > > >
> > > > > > > > t.f...@bb...
> > > > > > > >
> > > > > > > > Tel: 020 7631 6060
> > > > > > > > Fax: 020 7631 6066
> > > > > > > > http://www.bbk.ac.uk/lib/
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > >
> ------------------------------------------------------------------
> > > > > --
> > > > > > > > --
> > > > > > > > -------- Keep Your Developer Skills Current with
> LearnDevNow!
> > > > > > > > The most comprehensive online learning library for
> Microsoft
> > > > > > > > developers is just $99.99! Visual Studio, SharePoint, SQL
> -
> > > plus
> > > > > > > > HTML5, CSS3, MVC3, Metro Style Apps, more. Free future
> > > releases
> > > > > when
> > > > > > > you subscribe now!
> > > > > > > > http://p.sf.net/sfu/learndevnow-d2d
> > > > > > > > _______________________________________________
> > > > > > > > VuFind-General mailing list
> > > > > > > > VuF...@li...
> > > > > > > >
> https://lists.sourceforge.net/lists/listinfo/vufind-general