Re: [VuFind-General] Trouble with first_indexed/last_indexed fields

SourceForge Headquarters 225 Broadway Suite 1600 San Diego, CA 92101 +1 (858) 454-5900

I think you just need to create the missing change_tracker table.  This SQL should do the trick:

CREATE TABLE `change_tracker` (
  `core` varchar(30) NOT NULL,              -- solr core containing record
  `id` varchar(64) NOT NULL,                -- ID of record within core
  `first_indexed` datetime,                 -- first time added to index
  `last_indexed` datetime,                  -- last time changed in index
  `last_record_change` datetime,            -- last time original record was edited
  `deleted` datetime,                       -- time record was removed from index
  PRIMARY KEY (`core`, `id`),
  KEY `deleted_index` (`deleted`)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;

- Demian

From: Polgardy, Carolyn [mailto:Pol...@fr...]
Sent: Tuesday, November 15, 2011 10:04 AM
To: Demian Katz; vuf...@li...
Subject: RE: Trouble with first_indexed/last_indexed fields

Thanks, Demian!

Our import/lib folder does contain the correct libraries, and the Solr schema defines first_indexed and last_indexed fields.

Our database did not contain the change_tracker table at all.

The database connection string did contain double quotes - I removed them, then did a careful comparison of our config.ini versus the config.ini file contained in the 1.1 stable release to make sure everything matched up.  Restarted the server for good measure after that.

I attempted to import a sample set of MARC manually, using a file that I've successfully imported in the past.  The importer attempts to open the data file, then throws an error:
- (MarcImporter.java:84) - Unexpected database error
- (MarcImporter.java:363) - Serious Error flagged at 1 read from file: ocm31907983
- (MarcImporter.java:583) - Exception occurred while Indexing: Unexpected database error
The importer then shuts down.

The MySQL database is performing fine otherwise - I'm able to store user favorites and so on with no problem.  Do you think it's worth blowing away the database entirely and recreating it?

-- Carolyn

Carolyn Polgardy
Web Developer
The Free Library of Philadelphia
http://www.freelibrary.org

From: Demian Katz [mailto:dem...@vi...]
Sent: Tuesday, November 15, 2011 8:50 AM
To: Polgardy, Carolyn; vuf...@li...
Subject: RE: Trouble with first_indexed/last_indexed fields

A few things to check:

- Does your MySQL database contain a change_tracker table?  Is there any data in the table?
- Does your import/lib folder contain the ini4j and mysql-connector libraries?
- Does your solr schema (solr/biblio/conf/schema.xml) define first_indexed and last_indexed fields?
- Is your database connection string in web/conf/config.ini surrounded by double quotes?  If so, you should remove them - there is a bug in VuFind that causes parsing problems if quotes are found on this setting (it will be fixed in release 1.3)

If everything appears to be in order, it might be interesting to try temporarily putting a bad password in the config.ini connection string and retrying the import - if everything is hooked up correctly, this should cause a fatal error.  If the import still works, some other detail must be missing.

Regarding UpdateDateTracker.jar, that should be bundled inside the main SolrMarc jar (if memory serves); it's not a problem that you're not seeing it in your file system.

I hope this helps, and please let me know if you're still having trouble after going through these steps.

- Demian

From: Polgardy, Carolyn [mailto:Pol...@fr...]
Sent: Monday, November 14, 2011 3:14 PM
To: vuf...@li...
Subject: [VuFind-General] Trouble with first_indexed/last_indexed fields

Hello,

I'm having some trouble with the first_indexed and last_indexed fields in our Solr index and could use some help or advice.

At present, we create a full MARC extract every night from our live ILS, which we use for our current discovery tool (AquaBrowser).  I have been putting a copy of the extract on our VuFind server every so often, where I have a job set up to run the import overnight.  (Eventually, we'll FTP the fresh extract to the VuFind server every night, but for now I move the file manually.)

Last week, I edited the marc_local.properties file to uncomment the first_indexed and last_indexed fields, then let the import run overnight.  However, when I checked the Solr index the next morning, the import ran correctly but the first_indexed and last_indexed fields are not present in the data.  I've run the import a few more times since then, but no luck.

When I upgraded our VuFind install from version 1.0.1 to 1.1 a few months ago, I was in a rush, and I'm concerned that I missed a step or a file somewhere along the line.  I do believe I have the correct version of the VuFindIndexer.jar installed.  I see in the SolrMarc trunk that there's also a file called UpdateDateTracker.jar, which is not present in my install.  Do I need to install this on my VuFind server - and how would I go about doing that?

Thanks in advance!

Carolyn Polgardy
Web Developer
The Free Library of Philadelphia
http://www.freelibrary.org