Re: [GeoNetwork-users] Harvesting

SourceForge Headquarters 1320 Columbia Street Suite 310 San Diego, CA 92101 +1 (858) 422-6466

Hi again, I have workarounded the problem by setting "Validate"
option. Maybe this is the intended behaviour of the harvester..

Best regards,

César

2012/10/4 César Martínez Izquierdo <ces...@gm...>:
> Hello again, we have performed some tests.
>
> It seems the harvester finds an offending XML file and the process
> stops, thus no metadata is imported. This is quite inconvenient (and
> IMHO should be considered a bug), as many .XML files may be present in
> the file system, not necessarily being metadata records, so the proper
> behaviour should be to skip invalid metadata and import real metadata.
>
> The log says:
>
>     <error id="no-schema-matches">
>       <message>Autodetecting schema failed for metadata record with
> root element PAMDataset in namespace [Namespace: prefix "" is mapped
> to URI ""].</message
>>
>       <class>NoSchemaMatchesException</class>
>       <stack>
>         <at class="org.fao.geonet.kernel.SchemaManager"
> file="SchemaManager.java" line="640" method="autodetectSchema" />
>         <at class="org.fao.geonet.kernel.DataManager"
> file="DataManager.java" line="1362" method="autodetectSchema" />
>         <at class="org.fao.geonet.kernel.DataManager"
> file="DataManager.java" line="1343" method="autodetectSchema" />
>         <at class="org.fao.geonet.kernel.harvest.harvester.localfilesystem.LocalFilesystemHarvester"
> file="LocalFilesystemHarvester.java" line="244" method="align" />
>         <at class="org.fao.geonet.kernel.harvest.harvester.localfilesystem.LocalFilesystemHarvester"
> file="LocalFilesystemHarvester.java" line="397" method="doHarvest" />
>         <at class="org.fao.geonet.kernel.harvest.harvester.AbstractHarvester$HarvestWithIndexProcessor"
> file="AbstractHarvester.java" line="397" method="process" />
>         <at class="org.fao.geonet.kernel.MetadataIndexerProcessor"
> file="MetadataIndexerProcessor.java" line="39"
> method="processWithFastIndexing" />
>         <at class="org.fao.geonet.kernel.harvest.harvester.AbstractHarvester"
> file="AbstractHarvester.java" line="427" method="harvest" />
>         <at class="org.fao.geonet.kernel.harvest.harvester.HarvesterJob"
> file="HarvesterJob.java" line="29" method="execute" />
>         <at class="org.quartz.core.JobRunShell"
> file="JobRunShell.java" line="213" method="run" />
>         <skip>...</skip>
>       </stack>
>     </error>
>
>
> Best regads,
>
> César Martínez
>
> 2012/10/1 César Martínez Izquierdo <ces...@gm...>:
>> Thanks for the advise Jose, we'll perform several tests on DEBUG mode
>> and report back the results.
>>
>> Best regards,
>>
>> César
>>
>> 2012/9/28 Jose Garcia <jos...@ge...>:
>>> Hi Cesar
>>>
>>> When the harvester finishes do you get any error in the harvester list? If
>>> you put the mouse over the error icon, should provide some information about
>>> the error.
>>>
>>> Also hopefully more detailed information about the issue should be available
>>> in the log file (logs/geonetwork.log). If no information in the log file,
>>> please set DEBUG level for harvester module in
>>> INSTALL_DIR/geonetwork/WEB-INF/log4j.cfg, adding or editing if exists this
>>> line:
>>>
>>> log4j.logger.geonetwork.harvester   = DEBUG
>>>
>>> Restart GeoNetwork after the change and execute the harvester to check the
>>> log file.
>>>
>>> Regards,
>>> Jose García
>>>
>>>
>>> On Fri, Sep 28, 2012 at 12:12 PM, César Martínez Izquierdo
>>> <ces...@gm...> wrote:
>>>>
>>>> Hi Jose, I am a co-worker of Maria.
>>>> Our plan is to edit metadata using a separate tool, so the local
>>>> harvesting module seems the best option.
>>>>
>>>> We have configured it, but we been unable to harvest any metadata
>>>> (even if the same metadata records can be correctly imported using
>>>> manual import) and the user manual doesn't contain any information
>>>> about this harvester (we are using  2.8.0 RC1 version).
>>>>
>>>> Do you have any clue?
>>>>
>>>> Best regards,
>>>>
>>>> César
>>>>
>>>>
>>>> 2012/9/28 Jose Garcia <jos...@ge...>:
>>>> > Hi Maria
>>>> >
>>>> > If you need to import the metadata records to edit them later in
>>>> > GeoNetwork, it's better to use *Administration* > *Batch import* option
>>>> > instead of harvester, as harvested metadata is not editable by
>>>> > default. This can be changed in Administration > System configuration,
>>>> > enabling the setting "Allow editing on harvested records", but if you
>>>> > run
>>>> > harvester again, will loose edit changes.
>>>> >
>>>> > If you use *Batch import* option, note that the folder you have to
>>>> > configure should be a folder accesible from the server where GeoNetwork
>>>> > is
>>>> > installed, not a folder in your local computer.
>>>> >
>>>> > If you want to use anyway the *Local Filesystem harvester*, possibly
>>>> > same
>>>> > stuff related to the directory applies (not sure at all as never used
>>>> > this
>>>> > harvester).
>>>> >
>>>> > Regards,
>>>> > Jose García
>>>> >
>>>> > On Fri, Sep 28, 2012 at 10:14 AM, Maria Lozano Bernal <
>>>> > maf...@gm...> wrote:
>>>> >
>>>> >> Hi
>>>> >>
>>>> >> My name is maria, I wonder if anyone knows how I can import some
>>>> >> matadatos found
>>>> >> in xml file to local filesystem geonetwork harvesting, I could import
>>>> >> them
>>>> >> to
>>>> >> be displayed.
>>>> >>
>>>> >> Thank you.
>>>> >>
>>>> >>
>>>> >> ------------------------------------------------------------------------------
>>>> >> Got visibility?
>>>> >> Most devs has no idea what their production app looks like.
>>>> >> Find out how fast your code is with AppDynamics Lite.
>>>> >> http://ad.doubleclick.net/clk;262219671;13503038;y?
>>>> >> http://info.appdynamics.com/FreeJavaPerformanceDownload.html
>>>> >> _______________________________________________
>>>> >> GeoNetwork-users mailing list
>>>> >> Geo...@li...
>>>> >> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>>>> >> GeoNetwork OpenSource is maintained at
>>>> >> http://sourceforge.net/projects/geonetwork
>>>> >>
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > *
>>>> > GeoCat Bridge for ArcGIS allows instant publishing of data and metadata
>>>> > on
>>>> > GeoServer and GeoNetwork. Visit http://geocat.net for details.
>>>> > _________________________
>>>> > Jose García
>>>> > GeoCat bv
>>>> > Veenderweg 13
>>>> > 6721 WD Bennekom
>>>> > The Netherlands
>>>> > http://GeoCat.net <http://geocat.net/>
>>>> >
>>>> > *
>>>> >
>>>> > ------------------------------------------------------------------------------
>>>> > Got visibility?
>>>> > Most devs has no idea what their production app looks like.
>>>> > Find out how fast your code is with AppDynamics Lite.
>>>> > http://ad.doubleclick.net/clk;262219671;13503038;y?
>>>> > http://info.appdynamics.com/FreeJavaPerformanceDownload.html
>>>> > _______________________________________________
>>>> > GeoNetwork-users mailing list
>>>> > Geo...@li...
>>>> > https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>>>> > GeoNetwork OpenSource is maintained at
>>>> > http://sourceforge.net/projects/geonetwork
>>>>
>>>>
>>>>
>>>> --
>>>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
>>>>    César Martínez Izquierdo
>>>>    GIS developer
>>>>    -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -
>>>>    ETC-SIA: http://sia.eionet.europa.eu/
>>>>    Universitat Autònoma de Barcelona (SPAIN)
>>>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
>>>
>>>
>>>
>>>
>>> --
>>> GeoCat Bridge for ArcGIS allows instant publishing of data and metadata on
>>> GeoServer and GeoNetwork. Visit http://geocat.net for details.
>>> _________________________
>>> Jose García
>>> GeoCat bv
>>> Veenderweg 13
>>> 6721 WD Bennekom
>>> The Netherlands
>>> http://GeoCat.net
>>>
>>>
>>
>>
>>
>> --
>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
>>    César Martínez Izquierdo
>>    GIS developer
>>    -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -
>>    ETC-SIA: http://sia.eionet.europa.eu/
>>    Universitat Autònoma de Barcelona (SPAIN)
>> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
>
>
>
> --
> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
>    César Martínez Izquierdo
>    GIS developer
>    -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -
>    ETC-SIA: http://sia.eionet.europa.eu/
>    Universitat Autònoma de Barcelona (SPAIN)
> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -

-- 
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
   César Martínez Izquierdo
   GIS developer
   -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -  -
   ETC-SIA: http://sia.eionet.europa.eu/
   Universitat Autònoma de Barcelona (SPAIN)
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -