From: Adam B. <ab...@br...> - 2008-02-07 14:49:40
|
I'm working on developing a driver for III and have some questions about the best places to make changes in order to make things work. We've gotten pretty far (eg, we can display basic status info): http://tricycle.brynmawr.edu/vufind/Search/Home?lookfor=&type=all&submit=Fin d The Innovative Catalog uses a Record Identifier stored in the 935|a. The identifier is a combination of a .b and a 7 or greater digit number with the last digit being a check digit. Thus far, we've : - changed the marcxml2solr.xsl to use an ID field of the 935|a (which seemed to have little effect) - changed the controlfield and subfield in the import.properties (for the java importer) to the 935|a The problem is that VUFind doesn't seem to like the .b in the record id when doing things like record views: Eg: http://tricycle.brynmawr.edu/vufind/Record/.b10005286 My Questions are: ------------------------- a) should I be changing the .htaccess mappings and record display/storage information to allow alpha numeric ids? Or, should I be editing the importer to strip them out there b) if I should be editing the importer, are people making changes there for different drivers, if so, is there a standard switch or set of switches that appropriately make the changes? c) In order to make this work, we're using screen scraping to request the data from the catalog, is there any issue with adding a requirement of libcurl to PHP? Thanks, Adam _____________________________________ Tri-Colleges Systems Coordinator Bryn Mawr | Haverford | Swarthmore 610.526.5294 |
From: Andrew N. <and...@vi...> - 2008-02-07 15:58:43
|
> We've gotten pretty far (eg, we can display basic status info) Cool! > The problem is that VUFind doesn't seem to like the .b in the record id > when > doing things like record views: > > Eg: http://tricycle.brynmawr.edu/vufind/Record/.b10005286 > > > My Questions are: > ------------------------- > a) should I be changing the .htaccess mappings and record > display/storage > information to allow alpha numeric ids? Or, should I be editing the > importer > to strip them out there > > b) if I should be editing the importer, are people making changes there > for > different drivers, if so, is there a standard switch or set of switches > that > appropriately make the changes? Either approach is fine - It would be pretty easy to change the regex in the .htaccess to match the schema of your IDs. We have not customized the java importer based on any specific ILS. You could change it to filter your IDs, but then that might be harder to keep up with future changes. I'd say go with editing the .htaccess file > > c) In order to make this work, we're using screen scraping to request > the > data from the catalog, is there any issue with adding a requirement of > libcurl to PHP? That's not a problem since curl is pretty common - however we already use the PEAR HTTP_Request class for doing web transacations so you may want to consider using this library. I am working on a screen scraper for Voyager and it is using the HTTP_Request class as well. Andrew |
From: Casson, R. D. <cas...@mu...> - 2008-02-07 16:18:36
|
just making sure people have looked at davidWalker's III scraper: http://xerxes.calstate.edu/source/iii/ i know that ryan eby is using it for some things at aadl, and we can all vouch for david's abilities :) may not be what you exactly need, but probably something to look at. cheers, rob ________________________________________ From: vuf...@li... [vuf...@li...] On Behalf Of Andrew Nagy [and...@vi...] Sent: Thursday, February 07, 2008 10:58 AM To: Adam Brin; vuf...@li... Subject: Re: [VuFind-Tech] driver questions -- III > We've gotten pretty far (eg, we can display basic status info) Cool! > The problem is that VUFind doesn't seem to like the .b in the record id > when > doing things like record views: > > Eg: http://tricycle.brynmawr.edu/vufind/Record/.b10005286 > > > My Questions are: > ------------------------- > a) should I be changing the .htaccess mappings and record > display/storage > information to allow alpha numeric ids? Or, should I be editing the > importer > to strip them out there > > b) if I should be editing the importer, are people making changes there > for > different drivers, if so, is there a standard switch or set of switches > that > appropriately make the changes? Either approach is fine - It would be pretty easy to change the regex in the .htaccess to match the schema of your IDs. We have not customized the java importer based on any specific ILS. You could change it to filter your IDs, but then that might be harder to keep up with future changes. I'd say go with editing the .htaccess file > > c) In order to make this work, we're using screen scraping to request > the > data from the catalog, is there any issue with adding a requirement of > libcurl to PHP? That's not a problem since curl is pretty common - however we already use the PEAR HTTP_Request class for doing web transacations so you may want to consider using this library. I am working on a screen scraper for Voyager and it is using the HTTP_Request class as well. Andrew ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Vufind-tech mailing list Vuf...@li... https://lists.sourceforge.net/lists/listinfo/vufind-tech |
From: Adam B. <ab...@br...> - 2008-02-07 19:55:44
|
Robert, David Walker's scraper could work. I'm not sure if it's overkill for what we need here though, especially when trying to optimize for response time. It takes the record and converts it to MARCXML, which we would have to convert back to the array. Thoughts? - adam _____________________________________ Tri-Colleges Systems Coordinator Bryn Mawr | Haverford | Swarthmore 610.526.5294 -----Original Message----- From: vuf...@li... [mailto:vuf...@li...] On Behalf Of Casson, Robert D. Sent: Thursday, February 07, 2008 11:18 AM To: vuf...@li... Subject: Re: [VuFind-Tech] driver questions -- III just making sure people have looked at davidWalker's III scraper: http://xerxes.calstate.edu/source/iii/ i know that ryan eby is using it for some things at aadl, and we can all vouch for david's abilities :) may not be what you exactly need, but probably something to look at. cheers, rob ________________________________________ From: vuf...@li... [vuf...@li...] On Behalf Of Andrew Nagy [and...@vi...] Sent: Thursday, February 07, 2008 10:58 AM To: Adam Brin; vuf...@li... Subject: Re: [VuFind-Tech] driver questions -- III > We've gotten pretty far (eg, we can display basic status info) Cool! > The problem is that VUFind doesn't seem to like the .b in the record id > when > doing things like record views: > > Eg: http://tricycle.brynmawr.edu/vufind/Record/.b10005286 > > > My Questions are: > ------------------------- > a) should I be changing the .htaccess mappings and record > display/storage > information to allow alpha numeric ids? Or, should I be editing the > importer > to strip them out there > > b) if I should be editing the importer, are people making changes there > for > different drivers, if so, is there a standard switch or set of switches > that > appropriately make the changes? Either approach is fine - It would be pretty easy to change the regex in the .htaccess to match the schema of your IDs. We have not customized the java importer based on any specific ILS. You could change it to filter your IDs, but then that might be harder to keep up with future changes. I'd say go with editing the .htaccess file > > c) In order to make this work, we're using screen scraping to request > the > data from the catalog, is there any issue with adding a requirement of > libcurl to PHP? That's not a problem since curl is pretty common - however we already use the PEAR HTTP_Request class for doing web transacations so you may want to consider using this library. I am working on a screen scraper for Voyager and it is using the HTTP_Request class as well. Andrew ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Vufind-tech mailing list Vuf...@li... https://lists.sourceforge.net/lists/listinfo/vufind-tech ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Vufind-tech mailing list Vuf...@li... https://lists.sourceforge.net/lists/listinfo/vufind-tech |
From: Casson, R. D. <cas...@mu...> - 2008-02-07 22:59:21
|
yeah, it might be overkill, altho maybe just pull out all the extra stuff he's doing? just a thought, and i feel your pain, but applaud your effort...writing a plugin for III ;) cheers, and now back to lurking, rc ________________________________________ From: Adam Brin [ab...@br...] Sent: Thursday, February 07, 2008 2:55 PM To: Casson, Robert D.; vuf...@li... Subject: RE: [VuFind-Tech] driver questions -- III Robert, David Walker's scraper could work. I'm not sure if it's overkill for what we need here though, especially when trying to optimize for response time. It takes the record and converts it to MARCXML, which we would have to convert back to the array. Thoughts? - adam _____________________________________ Tri-Colleges Systems Coordinator Bryn Mawr | Haverford | Swarthmore 610.526.5294 -----Original Message----- From: vuf...@li... [mailto:vuf...@li...] On Behalf Of Casson, Robert D. Sent: Thursday, February 07, 2008 11:18 AM To: vuf...@li... Subject: Re: [VuFind-Tech] driver questions -- III just making sure people have looked at davidWalker's III scraper: http://xerxes.calstate.edu/source/iii/ i know that ryan eby is using it for some things at aadl, and we can all vouch for david's abilities :) may not be what you exactly need, but probably something to look at. cheers, rob ________________________________________ From: vuf...@li... [vuf...@li...] On Behalf Of Andrew Nagy [and...@vi...] Sent: Thursday, February 07, 2008 10:58 AM To: Adam Brin; vuf...@li... Subject: Re: [VuFind-Tech] driver questions -- III > We've gotten pretty far (eg, we can display basic status info) Cool! > The problem is that VUFind doesn't seem to like the .b in the record id > when > doing things like record views: > > Eg: http://tricycle.brynmawr.edu/vufind/Record/.b10005286 > > > My Questions are: > ------------------------- > a) should I be changing the .htaccess mappings and record > display/storage > information to allow alpha numeric ids? Or, should I be editing the > importer > to strip them out there > > b) if I should be editing the importer, are people making changes there > for > different drivers, if so, is there a standard switch or set of switches > that > appropriately make the changes? Either approach is fine - It would be pretty easy to change the regex in the .htaccess to match the schema of your IDs. We have not customized the java importer based on any specific ILS. You could change it to filter your IDs, but then that might be harder to keep up with future changes. I'd say go with editing the .htaccess file > > c) In order to make this work, we're using screen scraping to request > the > data from the catalog, is there any issue with adding a requirement of > libcurl to PHP? That's not a problem since curl is pretty common - however we already use the PEAR HTTP_Request class for doing web transacations so you may want to consider using this library. I am working on a screen scraper for Voyager and it is using the HTTP_Request class as well. Andrew ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Vufind-tech mailing list Vuf...@li... https://lists.sourceforge.net/lists/listinfo/vufind-tech ------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ Vufind-tech mailing list Vuf...@li... https://lists.sourceforge.net/lists/listinfo/vufind-tech |