Menu
▾
▴
Re: [GeoNetwork-devel] [GeoNetwork-users] Harvesting of CSW 2.0.2
|
From: heikki <tro...@gm...> - 2008-09-17 16:06:48
|
Okay, as for the 3rd source, it specifies that SOAP encoding must be used in GetRecords in its GetCapabilities response, but the GeoNetwork harvester ignores this, and doesn't use SOAP. I'll see if I can fix that quickly and try again. Kind regards Heikki Doeleman On Wed, Sep 17, 2008 at 8:56 AM, heikki <tro...@gm...> wrote: > Hi Michael, > > I'm not sure about the tarball but it certainly looks like it i sthe latest > code, judging from the line numbers. > > I've been trying to harvest from the 3 sources you mention, with the > results as below (none successful, all in a different way). In the first > source I get a timeout on GetCapabilities, that's where it ends; in the > other 2 sources GetCapabilitites goes fine, but then GetRecords chokes, > albeit in 2 different ways. > > Meanwhile maybe you could try to harvest from one of the sources that I can > successfully harvest, as a complementary test ? Try for example > http://www.geodata.alterra.nl/excat/csw?request=GetCapabilities&service=CSW&acceptVersions=2.0.2 > . > > I'll continue to look into this, in the meantime.. > > 1. Could not test, request timeout > > 2. > http://gdz.bkg.bund.de/advmiscsw/advmiscsw?Request=GetCapabilities&Service=CSW > > GR request : > > <csw:GetRecords xmlns:csw="http://www.opengis.net/cat/csw/2.0.2" > service="CSW" version="2.0.2" resultType="results" startPosition= > "1" maxRecords="10"> > <csw:Query> > <csw:ElementSetName>summary</csw:ElementSetName> > </csw:Query> > </csw:GetRecords> > > GR response : > > <ExceptionReport xmlns="http://www.opengis.net/ows" xmlns:xsi=" > http://www.w3.org/2001/XMLSchema-instance" language="en" version="1 > .0.0" xsi:schemaLocation="http://www.opengis.net/ows > http://schemas.opengis.net/ows/1.0.0/owsExceptionReport.xsd"> > <Exception exceptionCode="MissingParameterValue" locator="typeNames"> > <ExceptionText>Attribute 'typeNames' is missing.</ExceptionText> > </Exception> > </ExceptionReport> > > I do not know why this is returned. The GetRecords request is exactly the > same as it is sent to CSW202 servers which I can harvest succesfully. I'll > check this request against the CSW 202 XSD though. > > > 3. > http://www.sdi-suite.de/soapServices/CSWStartup?Request=GetCapabilities&Service=CSW > > request : > > <csw:GetRecords xmlns:csw="http://www.opengis.net/cat/csw/2.0.2" > service="CSW" version="2.0.2" resultType="results" startPosition= > "1" maxRecords="10"> > <csw:Query> > <csw:ElementSetName>summary</csw:ElementSetName> > </csw:Query> > </csw:GetRecords> > > the response is unparseable: the GN harvesting client throws > "org.xml.sax.SAXParseException: Invalid encoding name "UTF8"." Xerces does > this if it tries to parse a document that has encoding "UTF8" rather than > "UTF-8" -- apparently this is what the harvesting source returns.. > > Then I fixed this by setting feature " > http://apache.org/xml/features/allow-java-encodings" in class > org.fao.geonet.csw.common.util.Xml, the response can be parsed but it is > > <soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" > xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi > ="http://www.w3.org/2001/XMLSchema-instance"> > <soapenv:Body> > <soapenv:Fault> > <faultcode xmlns:ns1="http://xml.apache.org/axis/ > ">ns1:Client.NoSOAPAction</faultcode> > <faultstring>no SOAPAction header!</faultstring> > <detail> > <ns2:hostname xmlns:ns2="http://xml.apache.org/axis/ > ">sdisuite</ns2:hostname> > </detail> > </soapenv:Fault> > </soapenv:Body> > </soapenv:Envelope> > > I have no clue yet why this is returned but it is obiously not the > GetRecords response that GeoNetwork is expecting .. > > Let's look into this more and find out what's wrong. I'll check in the > allow-java-encodings fix in the trunk. > > > Kind regards > Heikki Doeleman > > > > > > > > > > > > On Mon, Sep 15, 2008 at 7:35 AM, Michael Lill <Mic...@gm...> wrote: > >> Hi, >> >> thanks for the information, tried it immediately, but nothing changed, >> still not able to harvest csw2.0.1 or 2.0.2. >> >> I did the following: >> >> Because I never worked with svn bevore, I went to >> http://geonetwork.svn.sourceforge.net/viewvc/geonetwork/trunk/ and chose >> "Download GNU Tarball". (Do I need a real svn-client? Did I download old >> code?) >> >> Then copied it to one of my machines, compiled the installer with ant, >> copied it to another machine (new, empty and clean except of Java), >> installed and tested it with several Geonetwork-nodes and other CSWs. >> >> But there is the same error I got on all installations so far when trying >> to harvest csw: >> >> Class OperationAbortedEx >> Message Raised exception when searching >> Stack Harvester.java 356 >> Harvester.java 202 >> Harvester.java 92 >> CSWHarvester.java 211 >> AbstractHarvester.java 329 >> Executor.java 87 >> >> >> For example I tried harvesting csw from: >> >> 1. >> http://geoportal.dachplus.org:8080/geonetwork/srv/csw?Request=GetCapabilities&Service=CSW >> (a Geonetwork 2.2 installation from an initiative in the region of the >> Lake Constance that wants to offer harmonised data from Germany, Suisse and >> Austria; of course, I could harvest this one as Geonetwork-node, but we are >> testing csw..) >> >> 2. >> http://gdz.bkg.bund.de/advmiscsw/advmiscsw?Request=GetCapabilities&Service=CSW >> (an "old" Intergraph-System from a german goverment agency). >> >> 3. >> http://www.sdi-suite.de/soapServices/CSWStartup?Request=GetCapabilities&Service=CSW >> (another csw-software/catalogue as online demo) >> >> >> If you're interested in a special log-file or access to the machine, just >> give me a hint. >> >> >> >> Best regards, >> Michael Lill >> >> >> >> >> >> >> -------- Original-Nachricht -------- >> > Datum: Mon, 15 Sep 2008 03:16:02 -0700 >> > Von: heikki <tro...@gm...> >> > An: "Michael Lill" <Mic...@gm...> >> > CC: geo...@li... >> > Betreff: Re: [GeoNetwork-users] Harvesting of CSW 2.0.2 >> >> > hi Michael, >> > >> > your observation that CSW 2.0.2 harvesting won't work in any current >> > GeoNetwork release is correct. >> > >> > Amongst the problems were : in the harvesting client part the value of >> > OutputSchema from the GetCapabilities response was ignored, causing some >> > Harvesting servers to return metadata in DC, which was subsequently not >> > stored by GeoNetwork. And in GeoNetwork's harvesting server part the >> value >> > of OutputSchema was compared against values that are not the values in >> the >> > specification, so if it received a correct OutputSchema value it would >> > throw >> > an error. >> > >> > I have recently fixed these issues and you can find them in GeoNetwork's >> > svn >> > trunk. You can download the source using an svn client, and run >> > <download-dir>/install/ant to create an installer from the source. >> > >> > I'm quite curious how the new code will work for you; could you keep us >> > posted on how you're doing ? >> > >> > Kind regards >> > Heikki Doeleman >> > >> > >> > >> > On Mon, Sep 15, 2008 at 3:07 AM, Michael Lill <Mic...@gm...> >> wrote: >> > >> > > Hello to all, >> > > >> > > I' a member of a research team at the Technical University Munich >> > > (Technische Universität München - chair of geoinformation-systems of >> > Prof. >> > > Schilcher). We are testing different CSW-software against each other >> > (what >> > > features are included) and if they work together (especially >> harvesting >> > and >> > > differences in the implementation of the CSW-standard). Most of this >> > takes >> > > place in the context of the Humboldt-project (1) and INSPIRE. >> > > >> > > Our problem is now that nearly all of our CSWs are CSW 2.0.2, only >> > > Geonetwork (so far) is still 2.0.1. So we got some problems with the >> > > Harvesting-function in GeoNetwork. It seems to me unpossible to >> harvest >> > any >> > > 2.0.2 CSW with any Geonetwork-Release. >> > > >> > > This is really disappointing as we would like to use Geonetwork as >> main >> > CSW >> > > for our part at the Humboldt-project. >> > > >> > > >> > > I can hardly imagine that we are the first who want to harvest a >> > 2.0.2-CSW >> > > with Geonetwork!? >> > > >> > > >> > > We tried harvesting between Geonetwork, works fine with Geonetwork and >> > > CSW-type. But when adding a 2.0.2-csw we always get >> > "OperationAbortedEx, >> > > Raised exception when searching, ..". So far, I was not really >> > concerned as >> > > the manual says that only 2.0.1-csw is supported. >> > > >> > > So I tried a version of GeoNetwork by Archibald Warnock that I found >> > here >> > > (2). This one is able to deliver 2.0.2-csw, but it seems to me that >> the >> > > csw-harvesting-engine won't work with 2.0.2, neither with 2.0.1 >> > > (geonetwork-type harvesting works). I compiled this version on two >> > different >> > > machines, WinXP Pro Tablet and Win2003 Server and in both Geonetwork >> is >> > not >> > > able to harvest csw. >> > > >> > > >> > > So, is there anybody who solved the problem of harvesting 2.0.2-csw in >> > > Geonetwork, with or without keeping the ability to harvest 2.0.1-csw? >> > > >> > > We would appreciate any help! >> > > >> > > >> > > >> > > Thanks and Best Regards, >> > > >> > > Michael Lill >> > > >> > > >> > > (1) www.esdi-humboldt.eu >> > > (2) www.awcubed.com/index.php?page=csw-installation >> > > -- >> > > GMX startet ShortView.de. Hier findest Du Leute mit Deinen Interessen! >> > > Jetzt dabei sein: >> > > http://www.shortview.de/wasistshortview.php?mc=sv_ext_mf@gmx >> > > >> > > >> > ------------------------------------------------------------ >> ------------- >> > > This SF.Net email is sponsored by the Moblin Your Move Developer's >> > > challenge >> > > Build the coolest Linux based applications with Moblin SDK & win great >> > > prizes >> > > Grand prize is a trip for two to an Open Source event anywhere in the >> > world >> > > http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> > > _______________________________________________ >> > > GeoNetwork-users mailing list >> > > Geo...@li... >> > > https://lists.sourceforge.net/lists/listinfo/geonetwork-users >> > > GeoNetwork OpenSource is maintained at >> > > http://sourceforge.net/projects/geonetwork >> > > >> > ------------------------------------------------------------ >> ------------- >> > This SF.Net email is sponsored by the Moblin Your Move Developer's >> > challenge >> > Build the coolest Linux based applications with Moblin SDK & win great >> > prizes >> > Grand prize is a trip for two to an Open Source event anywhere in the >> > world >> > http://moblin-contest.org/redirect.php?banner_id=100&url=/ >> > _______________________________________________ >> > GeoNetwork-users mailing list >> > Geo...@li... >> > https://lists.sourceforge.net/lists/listinfo/geonetwork-users >> > GeoNetwork OpenSource is maintained at >> > http://sourceforge.net/projects/geonetwork >> >> -- >> GMX Kostenlose Spiele: Einfach online spielen und Spaß haben mit Pastry >> Passion! >> >> http://games.entertainment.gmx.net/de/entertainment/games/free/puzzle/6169196 >> > > |