UIUC OAI Metadata Harvesting Project / News: Recent posts

New Version of the ThumbGrabber

New features plus bug fixes

Posted by Thomas G. Habing 2006-08-31

New Version of the ActiveX OAIHarvesterObj Library 3.1

This release contains mostly minor improvements to the
reap.wsf command line OAI harvesting script. See the change logs for details.

Posted by Thomas G. Habing 2005-08-29

UIUC OAI-PMH ThumbGrabber 1.13 Released

Thumbgrabber is a utility that will process a directory full of OAI
XML records and create a thumbnail image of any digital objects
represented by the record. It does this by extracting Dublin Core
Identifier <dc:identifier> elements or special Thumbnail Source
<ui:thumbnailSource> elements from the record and attempting to
display those records in an embedded web browser. If it can
successfully navigate to the object in the web browser it will create
a thumbnail using one of three methods:... read more

Posted by Thomas G. Habing 2005-07-29

New Release of the ActiveX OAIHarvesterObj Library 3.0

Highlights of the 3.0 release:

* Better support of poorly behaving and non-compliant OAI data providers.

* Support for record provenance

* Improved support for repositories that require basic authorization or use secure HTTP (HTTPS)

* Improved support for friends

* Includes two command-line OAI harvesters: Reap.wsf with substantial improvements over the previous version, and the new BigHarvest.wsf which creates one large XML for the complete harvest.... read more

Posted by Thomas G. Habing 2005-03-20

ASP OAI 2.0 Data Providers 1.5 Released

This release includes miscellaneous modifications and bug fixes for all three ASP OAI 2.0 Data Providers.

Posted by Ying-ping Chen 2004-05-10

ASP OAI 2.0 Data Providers 1.4 Released

The following major changes were made in this release for the three ASP OAI 2.0 Data Providers:

For the DB Provider:
1. Added <description> node support in the response of the "Identify" request.
2. Performance improvement:
(a) Using one query to get all set information (setSpec) instead of querying the set information of each metadata record one by one.
(b) Added "TOP n" to important SELECT query statements for eliminating necessary data processing and transferring.
3. Thanks to Wei Dai (Fogler Library, University of Maine), a design error in the included sample database was identified. The sample database could not properly express the following two situations in MARC records:
(a) <datafield tag="650" ind1="" ind2="0">
<subfield code="a">A1 A2</subfield>
<subfield code="a">B</subfield>
<subfield code="a">C1 C2</subfield>
</datafield>
and
(b) <datafield tag="650" ind1="" ind2="0">
<subfield code="a">A1 A2</subfield>
</datafield>
<datafield tag="650" ind1="" ind2="0">
<subfield code="a">B</subfield>
</datafield>
<datafield tag="650" ind1="" ind2="0">
<subfield code="a">C1 C2</subfield>
</datafield>
It creates problems when generating oai_dc formatted metadata or recovering the original format of the MARC metadata. Therefore, fields "serialNo" and "serialNoSub" were added into table "metadata" for distinguishing different nodes and subfields in these nodes.... read more

Posted by Ying-ping Chen 2004-02-02

Bug fix release: ASP OAI 2.0 Static Repository Gateway 1.11

Bug fix release: node <friends> in the response of request Identify now returns correct content.

Posted by Ying-ping Chen 2003-10-06

ASP OAI 2.0 Static Repository Gateway 1.1 Released

The following major changes were made in this release:

1. Embedded the filename, version number, and check-in datetime as XML comments into the response.
2. Added the boot-time check procedure for the ASP application in order to check the availability of various objects used in the application and/or some miscellaneous items.

Posted by Ying-ping Chen 2003-09-15

ASP OAI 2.0 Data Providers 1.3 Released

For all three ASP OAI 2.0 Data Providers, the following major changes were made in this release:

1. Embedded the filename, version number, and check-in datetime as XML comments into the response.
2. Changed the OAI identifier format to oai:<namespace-identifier>:<local-identifier> as described in the specification.
3. Added the boot-time check procedure for the ASP application in order to check the availability of various objects used in the application and/or some miscellaneous items.

Posted by Ying-ping Chen 2003-09-15

JSP OAI Data Provider 1.3 Released

This release fixed several bugs reported in the previous release. Additionally, the format of the OAI identifier was changed according to the guideline.

Posted by Ying-ping Chen 2003-09-08

ASP OAI 2.0 Static Repository Gateway Version 1.0 Release

This is an ASP OAI-PMH static repository gateway implementation as described in release 2.0 of the "Open Archives Initiative Protocol for Metadata Harvesting" and "Specification of the OAI Static Repository and Gateway - alpha version". It runs on Windows NT/2000 systems and supports the static repository cache mechanism. A gateway implementation in C for Linux or SunOS/Solaris systems can be found at http://sourceforge.net/projects/srepod/

Posted by Ying-ping Chen 2003-08-15

Three ASP OAI 2.0 Data Providers Version 1.2 Release

The updated ASP OAI 2.0 Data Providers are available. The data providers are designed for three different architectures: database, file system, and mix of database and file system.

For the database architecture, the data provider uses a database for both the metadata and the administrative information. We use Microsoft Access as an example in this package. For the file system architecture, XML files provide all metadata and administrative information. For the mixed architecture, the metadata are stored as XML files while the administrative information is in a database.

Posted by Ying-ping Chen 2003-07-31

Updated ASP/JSP OAI 2.0 Data Providers (Version 1.1) Release

The updated ASP/JSP OAI 2.0 Data Providers are available. The ASP data providers are designed for three different architectures: database, file system, and mix of database and file system. The JSP data provider is designed for the database only environment.

For the database architecture, the data provider uses a database for both the metadata and the administrative information. In the ASP version, we use Microsoft Access as an example, and in the JSP version, a MySQL database is included for demonstration. For the file system architecture, XML files provide all metadata and administrative information. For the mixed architecture, the metadata are stored as XML files while the administrative information is in a database.

Posted by Ying-ping Chen 2003-06-13

Three new ASP OAI 2.0 Data Providers available

The new ASP OAI 2.0 Data Providers are available for three different architectures: database, file system, and mix of database and file system.

For the database architecture, the data provider uses a database for both the metadata and the administrative information. For the file system architecture, XML files provide all metadata and administrative information. For the mixed architecture, the metadata are stored as XML files while the administrative information is in a database.

Posted by Ying-ping Chen 2003-04-23

Version 2.0 B4 of the OAI Java Harvester

Version 2.0 B4 of the UIUC Java-based OAI Harvester contains one significant bug fix and a couple minor enhancements.

The fixed bug was that resumptionTokens were not being properly encoded prior to sending them back to data providers.

The enhancements include added support for Basic HTTP Authorization in the uiuc.oai package, and a Perl script (provided by the OIAster project at the University of Michigan Digital Library Production Services) for purging all records for a given repository from the database.

Posted by Thomas G. Habing 2002-11-20

OAI 2.0 Data Provider for Java, Template B

This is an example of a metadata provider service as described in release 2.0 of the Open Archives Initiative Protocol for Metadata Harvesting.

The Template B provider assumes that metadata are stored in XML files. Other templates (forthcoming) assume metadata ore stored in databases.

It uses Apache web server, JDK1.3 or later, Tomcat servlet container that implements Java Servlet and JavaServer Pages technologies and JScript (including JDBC / XML packages), Xalan-Java for XSLT transformation, and MySQL database. ... read more

Posted by Yuping Tseng 2002-06-12

OAI 2.0 Data Provider for IIS, Template B

This is an example of a metadata provider service as described in release 2.0 of the Open Archives Initiative Protocol for Metadata Harvesting.

The Template B provider assumes that metadata are stored as XML files. Other templates (forthcoming) assume metadata stored in a database.

It uses Microsoft Internet Information Server technologies, Microsoft ASP with VBScript and JScript (including ODBC / ADO objects), Microsoft XML Parser (MSXML) 4.0, and Microsoft Access. This application can be downloaded onto an appropriately configured Microsoft Windows NT / Windows 2000 system and used with minimal configuration changes.

Posted by Thomas G. Habing 2002-06-12

Version 2.0 B1 of the Java and VB OAI Harvesters Released

2.0 Beta 1 versions of the both the Java and VB Harvesters developed by the University of Illinois at Urbana-Champaign OAI Metadata Harvesting Project have been released.

The VB and Java implementations are very similar. They share the same API and class structure, and each package consists of a Manager, Harvester, and Configuration module. Refer to the documentation of each package for details.

Posted by Thomas G. Habing 2002-06-03

OAI Harvester Object Library 2.0 B2 Released

Beta 2 of the OAIHarvesterObj developed by the University of Illinois at Urbana-Champaign OAI Metadata Harvesting Project has been released.

Minor API changes plus some bug fixes. See the change log for details.

Posted by Thomas G. Habing 2002-05-16

OAI Harvester Object Library 2.0 B1 Released

Version 2.0 B1 of the OAIHarvesterObj developed by the University of Illinois at Urbana-Champaign OAI Metadata Harvesting Project has been released.

This is an ActiveX DLL Class Library that supports the creation of OAI Harvesting services. This release supports the latest beta version of the OAI 2.0 protocol while also being backward compatible with versions 1.0 and 1.1 of the OAI protocol.

This release includes API documentation for the class library and also a simple command-line harvesting application, reap, which demonstrates how to use the class library in a Windows Scripting Host (WSH) environment.... read more

Posted by Thomas G. Habing 2002-05-09

OAI Harvester Library from U. Illinois at Urbana-Champaign

The UIUC OAI Metadata Harvesting Project software for creating OAI Providers & Harvesters is implemented in Visual Basic and Java, and includes various stand-alone packages, plus object libraries which can be used to develop custom Providers or Harvesters.

We have just made our first release of the OAI Harvester Code Library. This is an ActiveX DLL which can be used to write OAI 1.1 compliant Harvesters. We are now beginning work on support for the OAI 2.0 protocol.

Posted by Thomas G. Habing 2002-04-26