Re: [VuFind-Tech] MARC errors observed, possible XSLT filtering problem?

[Greg P. <pen...@us...>]

What timing! :)

Only this morning one of the faculty librarians points out another broken screen to me caused by the angle brackets you had problems with Calvin:

/web/sys/Solr.php : _process()
=================
$result = $xsl->transformToXML($xml);
$result = str_replace("&", "&", $result);
$result = str_replace(">",  ">", $result);
$result = str_replace("<",  "<", $result);


Greg Pendlebury 
Electronic Services Officer (Systems Team) 
Division of Academic Information Services 
University of Southern Queensland 
Phone: +61 7 4631 1501 
Fax: +61 7 4631 1841 

-----Original Message-----
From: Greg Pendlebury [mailto:pen...@us...] 
Sent: Monday, 30 March 2009 8:43 AM
To: 'Calvin Miracle'; 'vuf...@li...'
Subject: Re: [VuFind-Tech] MARC errors observed, possible XSLT filtering problem?

Hi Calvin,

I noticed this too.

Here's what we did:

http://sourceforge.net/mailarchive/forum.php?thread_name=5967C66FC7791D42AE1DE9C8F10BE1EE08139588%40TYCO.usq.edu.au&forum_name=vufind-tech 


Greg Pendlebury
Electronic Services Officer (Systems Team) Division of Academic Information Services University of Southern Queensland
Phone: +61 7 4631 1501
Fax: +61 7 4631 1841 

-----Original Message-----
From: Calvin Miracle [mailto:cal...@lo...]
Sent: Friday, 27 February 2009 3:03 PM
To: vuf...@li...
Subject: [VuFind-Tech] MARC errors observed, possible XSLT filtering problem?


Hello all,

Here at Louisville, we are testing VuFind revision 1190. We have observed errors similar to the File_MARC_Exception reported by Philip Shafer on 9 February.  

We think that certain characters in tag data (the angle brackets, <>, and the ampersand &, at least) are being filtered out of the "fullrecord'  XML field in the request returned in web/sys/Solr.php.  

We've seen ( via a debugger/profiler) characters being dropped, and framing errors accumulate, which eventually cause a fatal error thrown in web/File/MARC.php on line 365. The fatal error is caused by tag processing eventually trying to "split" on subfield indicators in the *following* marc tag, resulting in a subfield string with a possible NULL value.

Keep in mind, we do not see a data-handling error in Solr... Angle brackets and ampersands are retrieved in the 'fullrecord' field from the Lucene search panel; but the equivalent search in Solr.php results in a filtered 'fullrecord'.

If anyone wants additional information about what we've seen, we can provide samples of our ISO-2709 records that provoke the problem, screen shots of Lucene queries, and debugger output. 

- Calvin Miracle and Liren Liu, University of Louisville Libraries




------------------------------------------------------------------------------
_______________________________________________
Vufind-tech mailing list
Vuf...@li...
https://lists.sourceforge.net/lists/listinfo/vufind-tech

This email (including any attached files) is confidential and is for the
intended recipient(s) only.  If you received this email by mistake,
please, as a courtesy, tell the sender, then delete this email.

The views and opinions are the originator's and do not necessarily
reflect those of the University of Southern Queensland.  Although all
reasonable precautions were taken to ensure that this email contained no
viruses at the time it was sent we accept no liability for any losses
arising from its receipt.

The University of Southern Queensland is a registered provider of
education with the Australian Government (CRICOS Institution Code No's.
QLD 00244B / NSW 02225M)



------------------------------------------------------------------------------
_______________________________________________
Vufind-tech mailing list
Vuf...@li...
https://lists.sourceforge.net/lists/listinfo/vufind-tech

This email (including any attached files) is confidential and is for the
intended recipient(s) only.  If you received this email by mistake,
please, as a courtesy, tell the sender, then delete this email.

The views and opinions are the originator's and do not necessarily
reflect those of the University of Southern Queensland.  Although all
reasonable precautions were taken to ensure that this email contained no
viruses at the time it was sent we accept no liability for any losses
arising from its receipt.

The University of Southern Queensland is a registered provider of
education with the Australian Government (CRICOS Institution Code No's.
QLD 00244B / NSW 02225M)