Geoportal issues

classic Classic list List threaded Threaded
24 messages Options
12
Reply | Threaded
Open this post in threaded view
|

Geoportal issues

Brian O'Hare
Hi

Has anyone had any problems trying to run a CSW harvest against ESRI
Geoportal. Geonetwork seems to catch a 'NoApplicableCodeException' from
Geoportal when trying to do a GetRecordsRequest. I've only noticed this
with requests to Geoportal.

cheers,

Brian.

--
Geospatial Software Developer (Geo Services)
EDINA
Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184
e: [hidden email]
w: http://edina.ac.uk


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.


------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Brent Wood
Brian,

I understand the Geonetwork catalogue behind http://www.geodata.govt.nz is harvesting records from the ESRI geoportal catalogue at  http://geoportal.doc.govt.nz/geoportal/catalog/main/home.page

The person looking after the geodata catalogue is rainer (at) silverstripe.com who may be able to advise you. I believe Simon Pigot was also involved in making this work successfully.

Cheers,

   Brent Wood 


--- On Tue, 4/16/13, Brian O'Hare <[hidden email]> wrote:

From: Brian O'Hare <[hidden email]>
Subject: [GeoNetwork-users] Geoportal issues
To: [hidden email]
Date: Tuesday, April 16, 2013, 11:21 PM

Hi

Has anyone had any problems trying to run a CSW harvest against ESRI
Geoportal. Geonetwork seems to catch a 'NoApplicableCodeException' from
Geoportal when trying to do a GetRecordsRequest. I've only noticed this
with requests to Geoportal.

cheers,

Brian.

--
Geospatial Software Developer (Geo Services)
EDINA
Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184
e: [hidden email]
w: http://edina.ac.uk


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.


------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

marten
Can you share the CSW requests that Geonetwork sends? Note that Geoportal Server expects OGC Filter, not CQL.

Marten Hogeweg
Esri

-----Original Message-----
From: [hidden email] [mailto:[hidden email]]
Sent: Tuesday, April 16, 2013 7:48 PM
To: [hidden email]; Brian O'Hare
Subject: Re: [GeoNetwork-users] Geoportal issues

Brian,

I understand the Geonetwork catalogue behind http://www.geodata.govt.nz is harvesting records from the ESRI geoportal catalogue at  http://geoportal.doc.govt.nz/geoportal/catalog/main/home.page

The person looking after the geodata catalogue is rainer (at) silverstripe.com who may be able to advise you. I believe Simon Pigot was also involved in making this work successfully.

Cheers,

   Brent Wood 


--- On Tue, 4/16/13, Brian O'Hare <[hidden email]> wrote:

From: Brian O'Hare <[hidden email]>
Subject: [GeoNetwork-users] Geoportal issues
To: [hidden email]
Date: Tuesday, April 16, 2013, 11:21 PM

Hi

Has anyone had any problems trying to run a CSW harvest against ESRI Geoportal. Geonetwork seems to catch a 'NoApplicableCodeException' from Geoportal when trying to do a GetRecordsRequest. I've only noticed this with requests to Geoportal.

cheers,

Brian.

--
Geospatial Software Developer (Geo Services) EDINA Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184
e: [hidden email]
w: http://edina.ac.uk


The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.


------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork


------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

SimonPigot
I implemented a harvester that uses the geoportal REST api instead of CSW (would prefer to use the standard yes but it could be an alternative if you need it to work and don't have time for sorting this out) so you could try this if you can't nail down the problems with CSW. The harvester is documented in the GeoNetwork 2.8.x manual at http://geonetwork-opensource.org/manuals/2.8.0/eng/users/managing_metadata/harvesting/geoPREST/index.html#geoportal-rest-harvester  - a lot depends on the version of the geoportal you are harvesting from (the open source geoportal should work with CSW, but for other versions such as 9.3.x, it might be better to use the geoportal REST api harvester in 2.8.x).

Cheers,
Simon
________________________________________
From: Marten Hogeweg [[hidden email]]
Sent: Wednesday, 17 April 2013 4:10 AM
To: [hidden email]; [hidden email]; Brian O'Hare
Subject: Re: [GeoNetwork-users] Geoportal issues

Can you share the CSW requests that Geonetwork sends? Note that Geoportal Server expects OGC Filter, not CQL.

Marten Hogeweg
Esri

-----Original Message-----
From: [hidden email] [mailto:[hidden email]]
Sent: Tuesday, April 16, 2013 7:48 PM
To: [hidden email]; Brian O'Hare
Subject: Re: [GeoNetwork-users] Geoportal issues

Brian,

I understand the Geonetwork catalogue behind http://www.geodata.govt.nz is harvesting records from the ESRI geoportal catalogue at  http://geoportal.doc.govt.nz/geoportal/catalog/main/home.page

The person looking after the geodata catalogue is rainer (at) silverstripe.com who may be able to advise you. I believe Simon Pigot was also involved in making this work successfully.

Cheers,

   Brent Wood


--- On Tue, 4/16/13, Brian O'Hare <[hidden email]> wrote:

From: Brian O'Hare <[hidden email]>
Subject: [GeoNetwork-users] Geoportal issues
To: [hidden email]
Date: Tuesday, April 16, 2013, 11:21 PM

Hi

Has anyone had any problems trying to run a CSW harvest against ESRI Geoportal. Geonetwork seems to catch a 'NoApplicableCodeException' from Geoportal when trying to do a GetRecordsRequest. I've only noticed this with requests to Geoportal.

cheers,

Brian.

--
Geospatial Software Developer (Geo Services) EDINA Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184
e: [hidden email]
w: http://edina.ac.uk


The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.


------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork




------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Francois Prunayre
Hi, GeoNetwork checks the capability in order to send CQL or FE request.
I've been harvesting ESRI GeoPortal with CSW with no issue.
Could you share the URL to be harvested ?

Cheers.

Francois


2013/4/17 <[hidden email]>

> I implemented a harvester that uses the geoportal REST api instead of CSW
> (would prefer to use the standard yes but it could be an alternative if you
> need it to work and don't have time for sorting this out) so you could try
> this if you can't nail down the problems with CSW. The harvester is
> documented in the GeoNetwork 2.8.x manual at
> http://geonetwork-opensource.org/manuals/2.8.0/eng/users/managing_metadata/harvesting/geoPREST/index.html#geoportal-rest-harvester - a lot depends on the version of the geoportal you are harvesting from
> (the open source geoportal should work with CSW, but for other versions
> such as 9.3.x, it might be better to use the geoportal REST api harvester
> in 2.8.x).
>
> Cheers,
> Simon
> ________________________________________
> From: Marten Hogeweg [[hidden email]]
> Sent: Wednesday, 17 April 2013 4:10 AM
> To: [hidden email]; [hidden email]; Brian
> O'Hare
> Subject: Re: [GeoNetwork-users] Geoportal issues
>
> Can you share the CSW requests that Geonetwork sends? Note that Geoportal
> Server expects OGC Filter, not CQL.
>
> Marten Hogeweg
> Esri
>
> -----Original Message-----
> From: [hidden email] [mailto:[hidden email]]
> Sent: Tuesday, April 16, 2013 7:48 PM
> To: [hidden email]; Brian O'Hare
> Subject: Re: [GeoNetwork-users] Geoportal issues
>
> Brian,
>
> I understand the Geonetwork catalogue behind http://www.geodata.govt.nzis harvesting records from the ESRI geoportal catalogue at
> http://geoportal.doc.govt.nz/geoportal/catalog/main/home.page
>
> The person looking after the geodata catalogue is rainer (at)
> silverstripe.com who may be able to advise you. I believe Simon Pigot was
> also involved in making this work successfully.
>
> Cheers,
>
>    Brent Wood
>
>
> --- On Tue, 4/16/13, Brian O'Hare <[hidden email]> wrote:
>
> From: Brian O'Hare <[hidden email]>
> Subject: [GeoNetwork-users] Geoportal issues
> To: [hidden email]
> Date: Tuesday, April 16, 2013, 11:21 PM
>
> Hi
>
> Has anyone had any problems trying to run a CSW harvest against ESRI
> Geoportal. Geonetwork seems to catch a 'NoApplicableCodeException' from
> Geoportal when trying to do a GetRecordsRequest. I've only noticed this
> with requests to Geoportal.
>
> cheers,
>
> Brian.
>
> --
> Geospatial Software Developer (Geo Services) EDINA Causewayside House
> 160 Causewayside
> Edinburgh EH9 1PR
>
> p: +44 (0)131 5601184
> e: [hidden email]
> w: http://edina.ac.uk
>
>
> The University of Edinburgh is a charitable body, registered in Scotland,
> with registration number SC005336.
>
>
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use our
> toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use our
> toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>
>
>
>
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use
> our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>
------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Brian O'Hare
Many thanks everyone for your help.

I've enabled HttpClient debug logging in Geonetwork but can't see the
request going to geoportal. However I have used a debugger on the
running tomcat and can see that the request is using Filter not CQL. It
should just be a straightforward GetRecords request. The capabilities
file is parsed without problems. Here's some logging output - you can
see the Geoportal url here also:

2013-04-17 09:32:58,384 [schema: kb] DEBUG
[org.apache.commons.httpclient.HttpConnection] - Open connection to
www.ngdc.noaa.gov:80
2013-04-17 09:32:58,529 [schema: kb] DEBUG
[org.apache.commons.httpclient.HttpMethodBase] - Adding Host request header
2013-04-17 09:32:58,529 [schema: kb] WARN
[org.apache.commons.httpclient.cookie.CookieSpec] - Invalid cookie
state: domain not specified
2013-04-17 09:32:58,529 [schema: kb] DEBUG
[org.apache.commons.httpclient.methods.EntityEnclosingMethod] - Request
body sent
2013-04-17 09:32:58,760 [schema: kb] WARN
[org.apache.commons.httpclient.HttpMethodBase] - Cookie rejected:
"JSESSIONID=70FF886352F32B7A0FB5996515DFB29E". Illegal path attribute
"/geoportal". Path of origin: "http://www.ngdc.noaa.gov/geoportal/csw"
2013-04-17 09:32:58,763 [schema: kb] DEBUG
[org.apache.commons.httpclient.HttpMethodBase] - Should close connection
in response to directive: close
2013-04-17 09:32:58,763 [schema: kb] DEBUG
[org.apache.commons.httpclient.HttpConnection] - Releasing connection
back to connection manager.
2013-04-17 09:32:58,763 [schema: kb] WARN  [geonetwork.harvester] -
Raised exception when searching :
org.fao.geonet.csw.common.exceptions.NoApplicableCodeEx:
code=NoApplicableCode, locator=null, message=
An exception occurred with no applicable code

Looks like its to do with cookies. I've rebuilt geonetwork and set
cookie policy to 'ignoreCookies' with no success - it still fails.
Geoportal version is reported as.

NGDC Geoportal Instance using ArcGIS Server Geoportal Extension 10 - OGC
CSW 2.0.2 ISO AP

I'll try Simon's restful harvester and see if I have more success.

thanks again all,

Brian.

On 17/04/13 07:24, Francois Prunayre wrote:

> Hi, GeoNetwork checks the capability in order to send CQL or FE
> request. I've been harvesting ESRI GeoPortal with CSW with no issue.
> Could you share the URL to be harvested ?
>
> Cheers.
>
> Francois
>
>
> 2013/4/17 <[hidden email] <mailto:[hidden email]>>
>
>     I implemented a harvester that uses the geoportal REST api instead
>     of CSW (would prefer to use the standard yes but it could be an
>     alternative if you need it to work and don't have time for sorting
>     this out) so you could try this if you can't nail down the
>     problems with CSW. The harvester is documented in the GeoNetwork
>     2.8.x manual at
>     http://geonetwork-opensource.org/manuals/2.8.0/eng/users/managing_metadata/harvesting/geoPREST/index.html#geoportal-rest-harvester
>      - a lot depends on the version of the geoportal you are
>     harvesting from (the open source geoportal should work with CSW,
>     but for other versions such as 9.3.x, it might be better to use
>     the geoportal REST api harvester in 2.8.x).
>
>     Cheers,
>     Simon
>     ________________________________________
>     From: Marten Hogeweg [[hidden email] <mailto:[hidden email]>]
>     Sent: Wednesday, 17 April 2013 4:10 AM
>     To: [hidden email] <mailto:[hidden email]>;
>     [hidden email]
>     <mailto:[hidden email]>; Brian O'Hare
>     Subject: Re: [GeoNetwork-users] Geoportal issues
>
>     Can you share the CSW requests that Geonetwork sends? Note that
>     Geoportal Server expects OGC Filter, not CQL.
>
>     Marten Hogeweg
>     Esri
>
>     -----Original Message-----
>     From: [hidden email] <mailto:[hidden email]>
>     [mailto:[hidden email] <mailto:[hidden email]>]
>     Sent: Tuesday, April 16, 2013 7:48 PM
>     To: [hidden email]
>     <mailto:[hidden email]>; Brian O'Hare
>     Subject: Re: [GeoNetwork-users] Geoportal issues
>
>     Brian,
>
>     I understand the Geonetwork catalogue behind
>     http://www.geodata.govt.nz is harvesting records from the ESRI
>     geoportal catalogue at
>     http://geoportal.doc.govt.nz/geoportal/catalog/main/home.page
>
>     The person looking after the geodata catalogue is rainer (at)
>     silverstripe.com <http://silverstripe.com> who may be able to
>     advise you. I believe Simon Pigot was also involved in making this
>     work successfully.
>
>     Cheers,
>
>        Brent Wood
>
>
>     --- On Tue, 4/16/13, Brian O'Hare <[hidden email]
>     <mailto:[hidden email]>> wrote:
>
>     From: Brian O'Hare <[hidden email]
>     <mailto:[hidden email]>>
>     Subject: [GeoNetwork-users] Geoportal issues
>     To: [hidden email]
>     <mailto:[hidden email]>
>     Date: Tuesday, April 16, 2013, 11:21 PM
>
>     Hi
>
>     Has anyone had any problems trying to run a CSW harvest against
>     ESRI Geoportal. Geonetwork seems to catch a
>     'NoApplicableCodeException' from Geoportal when trying to do a
>     GetRecordsRequest. I've only noticed this with requests to Geoportal.
>
>     cheers,
>
>     Brian.
>
>     --
>     Geospatial Software Developer (Geo Services) EDINA Causewayside House
>     160 Causewayside
>     Edinburgh EH9 1PR
>
>     p: +44 (0)131 5601184 <tel:%2B44%20%280%29131%205601184>
>     e: [hidden email] <mailto:[hidden email]>
>     w: http://edina.ac.uk
>
>
>     The University of Edinburgh is a charitable body, registered in
>     Scotland, with registration number SC005336.
>
>
>     ------------------------------------------------------------------------------
>     Precog is a next-generation analytics platform capable of advanced
>     analytics on semi-structured data. The platform includes APIs for
>     building apps and a phenomenal toolset for data science.
>     Developers can use our toolset for easy data analysis &
>     visualization. Get a free account!
>     http://www2.precog.com/precogplatform/slashdotnewsletter
>     _______________________________________________
>     GeoNetwork-users mailing list
>     [hidden email]
>     <mailto:[hidden email]>
>     https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>     GeoNetwork OpenSource is maintained at
>     http://sourceforge.net/projects/geonetwork
>     ------------------------------------------------------------------------------
>     Precog is a next-generation analytics platform capable of advanced
>     analytics on semi-structured data. The platform includes APIs for
>     building apps and a phenomenal toolset for data science.
>     Developers can use our toolset for easy data analysis &
>     visualization. Get a free account!
>     http://www2.precog.com/precogplatform/slashdotnewsletter
>     _______________________________________________
>     GeoNetwork-users mailing list
>     [hidden email]
>     <mailto:[hidden email]>
>     https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>     GeoNetwork OpenSource is maintained at
>     http://sourceforge.net/projects/geonetwork
>
>
>
>
>     ------------------------------------------------------------------------------
>     Precog is a next-generation analytics platform capable of advanced
>     analytics on semi-structured data. The platform includes APIs for
>     building
>     apps and a phenomenal toolset for data science. Developers can use
>     our toolset for easy data analysis & visualization. Get a free
>     account!
>     http://www2.precog.com/precogplatform/slashdotnewsletter
>     _______________________________________________
>     GeoNetwork-users mailing list
>     [hidden email]
>     <mailto:[hidden email]>
>     https://lists.sourceforge.net/lists/listinfo/geonetwork-users
>     GeoNetwork OpenSource is maintained at
>     http://sourceforge.net/projects/geonetwork
>
>
--
Geospatial Software Developer (Geo Services)
EDINA
Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184
e: [hidden email]
w: http://edina.ac.uk


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.

------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

SimonPigot
Brian,

GeoPortal REST harvester in GeoNetwork does seem to work ok on the NOAA site. I set up a harvester as shown in the image attached. I did have to create a gmiTogmd.xsl (attached), install it in web/geonetwork/xsl/conversion/import as the NOAA site is using ISO19115-2 (this xslt converts the top element and loses the rest of the gmi content) and select it in the harvester as an XSLT to apply to the content harvested from the geoportal site.

Cheers,
Simon
________________________________________
From: Brian O'Hare [[hidden email]]
Sent: Wednesday, 17 April 2013 6:51 PM
To: Francois Prunayre
Cc: Pigot, Simon (CMAR, Hobart); [hidden email]; [hidden email]; [hidden email]
Subject: Re: [GeoNetwork-users] Geoportal issues

Many thanks everyone for your help.

I've enabled HttpClient debug logging in Geonetwork but can't see the request going to geoportal. However I have used a debugger on the running tomcat and can see that the request is using Filter not CQL. It should just be a straightforward GetRecords request. The capabilities file is parsed without problems. Here's some logging output - you can see the Geoportal url here also:

2013-04-17 09:32:58,384 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpConnection] - Open connection to www.ngdc.noaa.gov:80<http://www.ngdc.noaa.gov:80>
2013-04-17 09:32:58,529 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpMethodBase] - Adding Host request header
2013-04-17 09:32:58,529 [schema: kb] WARN  [org.apache.commons.httpclient.cookie.CookieSpec] - Invalid cookie state: domain not specified
2013-04-17 09:32:58,529 [schema: kb] DEBUG [org.apache.commons.httpclient.methods.EntityEnclosingMethod] - Request body sent
2013-04-17 09:32:58,760 [schema: kb] WARN  [org.apache.commons.httpclient.HttpMethodBase] - Cookie rejected: "JSESSIONID=70FF886352F32B7A0FB5996515DFB29E". Illegal path attribute "/geoportal". Path of origin: "http://www.ngdc.noaa.gov/geoportal/csw"<http://www.ngdc.noaa.gov/geoportal/csw>
2013-04-17 09:32:58,763 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpMethodBase] - Should close connection in response to directive: close
2013-04-17 09:32:58,763 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpConnection] - Releasing connection back to connection manager.
2013-04-17 09:32:58,763 [schema: kb] WARN  [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.NoApplicableCodeEx: code=NoApplicableCode, locator=null, message=
An exception occurred with no applicable code

Looks like its to do with cookies. I've rebuilt geonetwork and set cookie policy to 'ignoreCookies' with no success - it still fails. Geoportal version is reported as.

NGDC Geoportal Instance using ArcGIS Server Geoportal Extension 10 - OGC CSW 2.0.2 ISO AP

I'll try Simon's restful harvester and see if I have more success.

thanks again all,

Brian.

On 17/04/13 07:24, Francois Prunayre wrote:
Hi, GeoNetwork checks the capability in order to send CQL or FE request. I've been harvesting ESRI GeoPortal with CSW with no issue.
Could you share the URL to be harvested ?

Cheers.

Francois


2013/4/17 <[hidden email]<mailto:[hidden email]>>
I implemented a harvester that uses the geoportal REST api instead of CSW (would prefer to use the standard yes but it could be an alternative if you need it to work and don't have time for sorting this out) so you could try this if you can't nail down the problems with CSW. The harvester is documented in the GeoNetwork 2.8.x manual at http://geonetwork-opensource.org/manuals/2.8.0/eng/users/managing_metadata/harvesting/geoPREST/index.html#geoportal-rest-harvester  - a lot depends on the version of the geoportal you are harvesting from (the open source geoportal should work with CSW, but for other versions such as 9.3.x, it might be better to use the geoportal REST api harvester in 2.8.x).

Cheers,
Simon
________________________________________
From: Marten Hogeweg [[hidden email]<mailto:[hidden email]>]
Sent: Wednesday, 17 April 2013 4:10 AM
To: [hidden email]<mailto:[hidden email]>; [hidden email]<mailto:[hidden email]>; Brian O'Hare
Subject: Re: [GeoNetwork-users] Geoportal issues

Can you share the CSW requests that Geonetwork sends? Note that Geoportal Server expects OGC Filter, not CQL.

Marten Hogeweg
Esri

-----Original Message-----
From: [hidden email]<mailto:[hidden email]> [mailto:[hidden email]<mailto:[hidden email]>]
Sent: Tuesday, April 16, 2013 7:48 PM
To: [hidden email]<mailto:[hidden email]>; Brian O'Hare
Subject: Re: [GeoNetwork-users] Geoportal issues

Brian,

I understand the Geonetwork catalogue behind http://www.geodata.govt.nz is harvesting records from the ESRI geoportal catalogue at  http://geoportal.doc.govt.nz/geoportal/catalog/main/home.page

The person looking after the geodata catalogue is rainer (at) silverstripe.com<http://silverstripe.com> who may be able to advise you. I believe Simon Pigot was also involved in making this work successfully.

Cheers,

   Brent Wood


--- On Tue, 4/16/13, Brian O'Hare <[hidden email]<mailto:[hidden email]>> wrote:

From: Brian O'Hare <[hidden email]<mailto:[hidden email]>>
Subject: [GeoNetwork-users] Geoportal issues
To: [hidden email]<mailto:[hidden email]>
Date: Tuesday, April 16, 2013, 11:21 PM

Hi

Has anyone had any problems trying to run a CSW harvest against ESRI Geoportal. Geonetwork seems to catch a 'NoApplicableCodeException' from Geoportal when trying to do a GetRecordsRequest. I've only noticed this with requests to Geoportal.

cheers,

Brian.

--
Geospatial Software Developer (Geo Services) EDINA Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184<tel:%2B44%20%280%29131%205601184>
e: [hidden email]<mailto:[hidden email]>
w: http://edina.ac.uk


The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.


------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]<mailto:[hidden email]>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]<mailto:[hidden email]>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork




------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]<mailto:[hidden email]>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork



--
Geospatial Software Developer (Geo Services)
EDINA
Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184
e: [hidden email]<mailto:[hidden email]>
w: http://edina.ac.uk



------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

geoportal-rest-harvester.png (104K) Download Attachment
1_Warning.txt (412 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

SimonPigot
Just in case the gmiTogmd.xsl converter got blocked by some zealous email server, I've committed it to 2.8.x and trunk (see web/src/main/webapp/xsl/conversion/import/gmiTogmd.xsl).

Cheers,
Simon
________________________________________
From: Pigot, Simon (CMAR, Hobart)
Sent: Thursday, 18 April 2013 9:29 AM
To: Brian O'Hare; Francois Prunayre
Cc: [hidden email]
Subject: RE: [GeoNetwork-users] Geoportal issues

Brian,

GeoPortal REST harvester in GeoNetwork does seem to work ok on the NOAA site. I set up a harvester as shown in the image attached. I did have to create a gmiTogmd.xsl (attached), install it in web/geonetwork/xsl/conversion/import as the NOAA site is using ISO19115-2 (this xslt converts the top element and loses the rest of the gmi content) and select it in the harvester as an XSLT to apply to the content harvested from the geoportal site.

Cheers,
Simon
________________________________________
From: Brian O'Hare [[hidden email]]
Sent: Wednesday, 17 April 2013 6:51 PM
To: Francois Prunayre
Cc: Pigot, Simon (CMAR, Hobart); [hidden email]; [hidden email]; [hidden email]
Subject: Re: [GeoNetwork-users] Geoportal issues

Many thanks everyone for your help.

I've enabled HttpClient debug logging in Geonetwork but can't see the request going to geoportal. However I have used a debugger on the running tomcat and can see that the request is using Filter not CQL. It should just be a straightforward GetRecords request. The capabilities file is parsed without problems. Here's some logging output - you can see the Geoportal url here also:

2013-04-17 09:32:58,384 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpConnection] - Open connection to www.ngdc.noaa.gov:80<http://www.ngdc.noaa.gov:80>
2013-04-17 09:32:58,529 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpMethodBase] - Adding Host request header
2013-04-17 09:32:58,529 [schema: kb] WARN  [org.apache.commons.httpclient.cookie.CookieSpec] - Invalid cookie state: domain not specified
2013-04-17 09:32:58,529 [schema: kb] DEBUG [org.apache.commons.httpclient.methods.EntityEnclosingMethod] - Request body sent
2013-04-17 09:32:58,760 [schema: kb] WARN  [org.apache.commons.httpclient.HttpMethodBase] - Cookie rejected: "JSESSIONID=70FF886352F32B7A0FB5996515DFB29E". Illegal path attribute "/geoportal". Path of origin: "http://www.ngdc.noaa.gov/geoportal/csw"<http://www.ngdc.noaa.gov/geoportal/csw>
2013-04-17 09:32:58,763 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpMethodBase] - Should close connection in response to directive: close
2013-04-17 09:32:58,763 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpConnection] - Releasing connection back to connection manager.
2013-04-17 09:32:58,763 [schema: kb] WARN  [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.NoApplicableCodeEx: code=NoApplicableCode, locator=null, message=
An exception occurred with no applicable code

Looks like its to do with cookies. I've rebuilt geonetwork and set cookie policy to 'ignoreCookies' with no success - it still fails. Geoportal version is reported as.

NGDC Geoportal Instance using ArcGIS Server Geoportal Extension 10 - OGC CSW 2.0.2 ISO AP

I'll try Simon's restful harvester and see if I have more success.

thanks again all,

Brian.

On 17/04/13 07:24, Francois Prunayre wrote:
Hi, GeoNetwork checks the capability in order to send CQL or FE request. I've been harvesting ESRI GeoPortal with CSW with no issue.
Could you share the URL to be harvested ?

Cheers.

Francois


2013/4/17 <[hidden email]<mailto:[hidden email]>>
I implemented a harvester that uses the geoportal REST api instead of CSW (would prefer to use the standard yes but it could be an alternative if you need it to work and don't have time for sorting this out) so you could try this if you can't nail down the problems with CSW. The harvester is documented in the GeoNetwork 2.8.x manual at http://geonetwork-opensource.org/manuals/2.8.0/eng/users/managing_metadata/harvesting/geoPREST/index.html#geoportal-rest-harvester  - a lot depends on the version of the geoportal you are harvesting from (the open source geoportal should work with CSW, but for other versions such as 9.3.x, it might be better to use the geoportal REST api harvester in 2.8.x).

Cheers,
Simon
________________________________________
From: Marten Hogeweg [[hidden email]<mailto:[hidden email]>]
Sent: Wednesday, 17 April 2013 4:10 AM
To: [hidden email]<mailto:[hidden email]>; [hidden email]<mailto:[hidden email]>; Brian O'Hare
Subject: Re: [GeoNetwork-users] Geoportal issues

Can you share the CSW requests that Geonetwork sends? Note that Geoportal Server expects OGC Filter, not CQL.

Marten Hogeweg
Esri

-----Original Message-----
From: [hidden email]<mailto:[hidden email]> [mailto:[hidden email]<mailto:[hidden email]>]
Sent: Tuesday, April 16, 2013 7:48 PM
To: [hidden email]<mailto:[hidden email]>; Brian O'Hare
Subject: Re: [GeoNetwork-users] Geoportal issues

Brian,

I understand the Geonetwork catalogue behind http://www.geodata.govt.nz is harvesting records from the ESRI geoportal catalogue at  http://geoportal.doc.govt.nz/geoportal/catalog/main/home.page

The person looking after the geodata catalogue is rainer (at) silverstripe.com<http://silverstripe.com> who may be able to advise you. I believe Simon Pigot was also involved in making this work successfully.

Cheers,

   Brent Wood


--- On Tue, 4/16/13, Brian O'Hare <[hidden email]<mailto:[hidden email]>> wrote:

From: Brian O'Hare <[hidden email]<mailto:[hidden email]>>
Subject: [GeoNetwork-users] Geoportal issues
To: [hidden email]<mailto:[hidden email]>
Date: Tuesday, April 16, 2013, 11:21 PM

Hi

Has anyone had any problems trying to run a CSW harvest against ESRI Geoportal. Geonetwork seems to catch a 'NoApplicableCodeException' from Geoportal when trying to do a GetRecordsRequest. I've only noticed this with requests to Geoportal.

cheers,

Brian.

--
Geospatial Software Developer (Geo Services) EDINA Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184<tel:%2B44%20%280%29131%205601184>
e: [hidden email]<mailto:[hidden email]>
w: http://edina.ac.uk


The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.


------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]<mailto:[hidden email]>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]<mailto:[hidden email]>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork




------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]<mailto:[hidden email]>
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork



--
Geospatial Software Developer (Geo Services)
EDINA
Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184
e: [hidden email]<mailto:[hidden email]>
w: http://edina.ac.uk



------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Brian O'Hare
Many thanks Simon, might give this a go.

cheers,

Brian.

On 18/04/13 00:37, [hidden email] wrote:

> Just in case the gmiTogmd.xsl converter got blocked by some zealous email server, I've committed it to 2.8.x and trunk (see web/src/main/webapp/xsl/conversion/import/gmiTogmd.xsl).
>
> Cheers,
> Simon
> ________________________________________
> From: Pigot, Simon (CMAR, Hobart)
> Sent: Thursday, 18 April 2013 9:29 AM
> To: Brian O'Hare; Francois Prunayre
> Cc: [hidden email]
> Subject: RE: [GeoNetwork-users] Geoportal issues
>
> Brian,
>
> GeoPortal REST harvester in GeoNetwork does seem to work ok on the NOAA site. I set up a harvester as shown in the image attached. I did have to create a gmiTogmd.xsl (attached), install it in web/geonetwork/xsl/conversion/import as the NOAA site is using ISO19115-2 (this xslt converts the top element and loses the rest of the gmi content) and select it in the harvester as an XSLT to apply to the content harvested from the geoportal site.
>
> Cheers,
> Simon
> ________________________________________
> From: Brian O'Hare [[hidden email]]
> Sent: Wednesday, 17 April 2013 6:51 PM
> To: Francois Prunayre
> Cc: Pigot, Simon (CMAR, Hobart); [hidden email]; [hidden email]; [hidden email]
> Subject: Re: [GeoNetwork-users] Geoportal issues
>
> Many thanks everyone for your help.
>
> I've enabled HttpClient debug logging in Geonetwork but can't see the request going to geoportal. However I have used a debugger on the running tomcat and can see that the request is using Filter not CQL. It should just be a straightforward GetRecords request. The capabilities file is parsed without problems. Here's some logging output - you can see the Geoportal url here also:
>
> 2013-04-17 09:32:58,384 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpConnection] - Open connection to www.ngdc.noaa.gov:80<http://www.ngdc.noaa.gov:80>
> 2013-04-17 09:32:58,529 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpMethodBase] - Adding Host request header
> 2013-04-17 09:32:58,529 [schema: kb] WARN  [org.apache.commons.httpclient.cookie.CookieSpec] - Invalid cookie state: domain not specified
> 2013-04-17 09:32:58,529 [schema: kb] DEBUG [org.apache.commons.httpclient.methods.EntityEnclosingMethod] - Request body sent
> 2013-04-17 09:32:58,760 [schema: kb] WARN  [org.apache.commons.httpclient.HttpMethodBase] - Cookie rejected: "JSESSIONID=70FF886352F32B7A0FB5996515DFB29E". Illegal path attribute "/geoportal". Path of origin: "http://www.ngdc.noaa.gov/geoportal/csw"<http://www.ngdc.noaa.gov/geoportal/csw>
> 2013-04-17 09:32:58,763 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpMethodBase] - Should close connection in response to directive: close
> 2013-04-17 09:32:58,763 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpConnection] - Releasing connection back to connection manager.
> 2013-04-17 09:32:58,763 [schema: kb] WARN  [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.NoApplicableCodeEx: code=NoApplicableCode, locator=null, message=
> An exception occurred with no applicable code
>
> Looks like its to do with cookies. I've rebuilt geonetwork and set cookie policy to 'ignoreCookies' with no success - it still fails. Geoportal version is reported as.
>
> NGDC Geoportal Instance using ArcGIS Server Geoportal Extension 10 - OGC CSW 2.0.2 ISO AP
>
> I'll try Simon's restful harvester and see if I have more success.
>
> thanks again all,
>
> Brian.
>
> On 17/04/13 07:24, Francois Prunayre wrote:
> Hi, GeoNetwork checks the capability in order to send CQL or FE request. I've been harvesting ESRI GeoPortal with CSW with no issue.
> Could you share the URL to be harvested ?
>
> Cheers.
>
> Francois
>
>
> 2013/4/17 <[hidden email]<mailto:[hidden email]>>
> I implemented a harvester that uses the geoportal REST api instead of CSW (would prefer to use the standard yes but it could be an alternative if you need it to work and don't have time for sorting this out) so you could try this if you can't nail down the problems with CSW. The harvester is documented in the GeoNetwork 2.8.x manual at http://geonetwork-opensource.org/manuals/2.8.0/eng/users/managing_metadata/harvesting/geoPREST/index.html#geoportal-rest-harvester  - a lot depends on the version of the geoportal you are harvesting from (the open source geoportal should work with CSW, but for other versions such as 9.3.x, it might be better to use the geoportal REST api harvester in 2.8.x).
>
> Cheers,
> Simon
> ________________________________________
> From: Marten Hogeweg [[hidden email]<mailto:[hidden email]>]
> Sent: Wednesday, 17 April 2013 4:10 AM
> To: [hidden email]<mailto:[hidden email]>; [hidden email]<mailto:[hidden email]>; Brian O'Hare
> Subject: Re: [GeoNetwork-users] Geoportal issues
>
> Can you share the CSW requests that Geonetwork sends? Note that Geoportal Server expects OGC Filter, not CQL.
>
> Marten Hogeweg
> Esri
>
> -----Original Message-----
> From: [hidden email]<mailto:[hidden email]> [mailto:[hidden email]<mailto:[hidden email]>]
> Sent: Tuesday, April 16, 2013 7:48 PM
> To: [hidden email]<mailto:[hidden email]>; Brian O'Hare
> Subject: Re: [GeoNetwork-users] Geoportal issues
>
> Brian,
>
> I understand the Geonetwork catalogue behind http://www.geodata.govt.nz is harvesting records from the ESRI geoportal catalogue at  http://geoportal.doc.govt.nz/geoportal/catalog/main/home.page
>
> The person looking after the geodata catalogue is rainer (at) silverstripe.com<http://silverstripe.com> who may be able to advise you. I believe Simon Pigot was also involved in making this work successfully.
>
> Cheers,
>
>     Brent Wood
>
>
> --- On Tue, 4/16/13, Brian O'Hare <[hidden email]<mailto:[hidden email]>> wrote:
>
> From: Brian O'Hare <[hidden email]<mailto:[hidden email]>>
> Subject: [GeoNetwork-users] Geoportal issues
> To: [hidden email]<mailto:[hidden email]>
> Date: Tuesday, April 16, 2013, 11:21 PM
>
> Hi
>
> Has anyone had any problems trying to run a CSW harvest against ESRI Geoportal. Geonetwork seems to catch a 'NoApplicableCodeException' from Geoportal when trying to do a GetRecordsRequest. I've only noticed this with requests to Geoportal.
>
> cheers,
>
> Brian.
>
> --
> Geospatial Software Developer (Geo Services) EDINA Causewayside House
> 160 Causewayside
> Edinburgh EH9 1PR
>
> p: +44 (0)131 5601184<tel:%2B44%20%280%29131%205601184>
> e: [hidden email]<mailto:[hidden email]>
> w: http://edina.ac.uk
>
>
> The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
>
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]<mailto:[hidden email]>
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]<mailto:[hidden email]>
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
>
>
>
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use
> our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]<mailto:[hidden email]>
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
>
>
>
> --
> Geospatial Software Developer (Geo Services)
> EDINA
> Causewayside House
> 160 Causewayside
> Edinburgh EH9 1PR
>
> p: +44 (0)131 5601184
> e: [hidden email]<mailto:[hidden email]>
> w: http://edina.ac.uk
>
>
>

--
Geospatial Software Developer (Geo Services)
EDINA
Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184
e: [hidden email]
w: http://edina.ac.uk


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.


------------------------------------------------------------------------------
Precog is a next-generation analytics platform capable of advanced
analytics on semi-structured data. The platform includes APIs for building
apps and a phenomenal toolset for data science. Developers can use
our toolset for easy data analysis & visualization. Get a free account!
http://www2.precog.com/precogplatform/slashdotnewsletter
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Brian O'Hare
In reply to this post by SimonPigot
Simon,

Your Geoportal REST harvester works very nicely thanks! I had to add
'sys.schema.key:iso19115-2' as a search criteria in the harvester config
to just harvest records with this schema as I was getting errors in
schema auto-detection when it came across RDF records in the NOAA
catalogue. See
https://github.com/Esri/geoportal-server/wiki/How-to-find-all-documents-of-a-particular-metadata-standard.

thanks again,

Brian

On 18/04/13 00:37, [hidden email] wrote:

> Just in case the gmiTogmd.xsl converter got blocked by some zealous email server, I've committed it to 2.8.x and trunk (see web/src/main/webapp/xsl/conversion/import/gmiTogmd.xsl).
>
> Cheers,
> Simon
> ________________________________________
> From: Pigot, Simon (CMAR, Hobart)
> Sent: Thursday, 18 April 2013 9:29 AM
> To: Brian O'Hare; Francois Prunayre
> Cc:[hidden email]
> Subject: RE: [GeoNetwork-users] Geoportal issues
>
> Brian,
>
> GeoPortal REST harvester in GeoNetwork does seem to work ok on the NOAA site. I set up a harvester as shown in the image attached. I did have to create a gmiTogmd.xsl (attached), install it in web/geonetwork/xsl/conversion/import as the NOAA site is using ISO19115-2 (this xslt converts the top element and loses the rest of the gmi content) and select it in the harvester as an XSLT to apply to the content harvested from the geoportal site.
>
> Cheers,
> Simon
> ________________________________________
> From: Brian O'Hare [[hidden email]]
> Sent: Wednesday, 17 April 2013 6:51 PM
> To: Francois Prunayre
> Cc: Pigot, Simon (CMAR, Hobart);[hidden email];[hidden email];[hidden email]
> Subject: Re: [GeoNetwork-users] Geoportal issues
>
> Many thanks everyone for your help.
>
> I've enabled HttpClient debug logging in Geonetwork but can't see the request going to geoportal. However I have used a debugger on the running tomcat and can see that the request is using Filter not CQL. It should just be a straightforward GetRecords request. The capabilities file is parsed without problems. Here's some logging output - you can see the Geoportal url here also:
>
> 2013-04-17 09:32:58,384 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpConnection] - Open connection towww.ngdc.noaa.gov:80<http://www.ngdc.noaa.gov:80>
> 2013-04-17 09:32:58,529 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpMethodBase] - Adding Host request header
> 2013-04-17 09:32:58,529 [schema: kb] WARN  [org.apache.commons.httpclient.cookie.CookieSpec] - Invalid cookie state: domain not specified
> 2013-04-17 09:32:58,529 [schema: kb] DEBUG [org.apache.commons.httpclient.methods.EntityEnclosingMethod] - Request body sent
> 2013-04-17 09:32:58,760 [schema: kb] WARN  [org.apache.commons.httpclient.HttpMethodBase] - Cookie rejected: "JSESSIONID=70FF886352F32B7A0FB5996515DFB29E". Illegal path attribute "/geoportal". Path of origin:"http://www.ngdc.noaa.gov/geoportal/csw"<http://www.ngdc.noaa.gov/geoportal/csw>
> 2013-04-17 09:32:58,763 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpMethodBase] - Should close connection in response to directive: close
> 2013-04-17 09:32:58,763 [schema: kb] DEBUG [org.apache.commons.httpclient.HttpConnection] - Releasing connection back to connection manager.
> 2013-04-17 09:32:58,763 [schema: kb] WARN  [geonetwork.harvester] - Raised exception when searching : org.fao.geonet.csw.common.exceptions.NoApplicableCodeEx: code=NoApplicableCode, locator=null, message=
> An exception occurred with no applicable code
>
> Looks like its to do with cookies. I've rebuilt geonetwork and set cookie policy to 'ignoreCookies' with no success - it still fails. Geoportal version is reported as.
>
> NGDC Geoportal Instance using ArcGIS Server Geoportal Extension 10 - OGC CSW 2.0.2 ISO AP
>
> I'll try Simon's restful harvester and see if I have more success.
>
> thanks again all,
>
> Brian.
>
> On 17/04/13 07:24, Francois Prunayre wrote:
> Hi, GeoNetwork checks the capability in order to send CQL or FE request. I've been harvesting ESRI GeoPortal with CSW with no issue.
> Could you share the URL to be harvested ?
>
> Cheers.
>
> Francois
>
>
> 2013/4/17 <[hidden email]<mailto:[hidden email]>>
> I implemented a harvester that uses the geoportal REST api instead of CSW (would prefer to use the standard yes but it could be an alternative if you need it to work and don't have time for sorting this out) so you could try this if you can't nail down the problems with CSW. The harvester is documented in the GeoNetwork 2.8.x manual athttp://geonetwork-opensource.org/manuals/2.8.0/eng/users/managing_metadata/harvesting/geoPREST/index.html#geoportal-rest-harvester   - a lot depends on the version of the geoportal you are harvesting from (the open source geoportal should work with CSW, but for other versions such as 9.3.x, it might be better to use the geoportal REST api harvester in 2.8.x).
>
> Cheers,
> Simon
> ________________________________________
> From: Marten Hogeweg [[hidden email]<mailto:[hidden email]>]
> Sent: Wednesday, 17 April 2013 4:10 AM
> To:[hidden email]<mailto:[hidden email]>;[hidden email]<mailto:[hidden email]>; Brian O'Hare
> Subject: Re: [GeoNetwork-users] Geoportal issues
>
> Can you share the CSW requests that Geonetwork sends? Note that Geoportal Server expects OGC Filter, not CQL.
>
> Marten Hogeweg
> Esri
>
> -----Original Message-----
> From:[hidden email]<mailto:[hidden email]>  [mailto:[hidden email]<mailto:[hidden email]>]
> Sent: Tuesday, April 16, 2013 7:48 PM
> To:[hidden email]<mailto:[hidden email]>; Brian O'Hare
> Subject: Re: [GeoNetwork-users] Geoportal issues
>
> Brian,
>
> I understand the Geonetwork catalogue behindhttp://www.geodata.govt.nz  is harvesting records from the ESRI geoportal catalogue athttp://geoportal.doc.govt.nz/geoportal/catalog/main/home.page
>
> The person looking after the geodata catalogue is rainer (at) silverstripe.com<http://silverstripe.com>  who may be able to advise you. I believe Simon Pigot was also involved in making this work successfully.
>
> Cheers,
>
>     Brent Wood
>
>
> --- On Tue, 4/16/13, Brian O'Hare <[hidden email]<mailto:[hidden email]>> wrote:
>
> From: Brian O'Hare <[hidden email]<mailto:[hidden email]>>
> Subject: [GeoNetwork-users] Geoportal issues
> To:[hidden email]<mailto:[hidden email]>
> Date: Tuesday, April 16, 2013, 11:21 PM
>
> Hi
>
> Has anyone had any problems trying to run a CSW harvest against ESRI Geoportal. Geonetwork seems to catch a 'NoApplicableCodeException' from Geoportal when trying to do a GetRecordsRequest. I've only noticed this with requests to Geoportal.
>
> cheers,
>
> Brian.
>
> --
> Geospatial Software Developer (Geo Services) EDINA Causewayside House
> 160 Causewayside
> Edinburgh EH9 1PR
>
> p: +44 (0)131 5601184<tel:%2B44%20%280%29131%205601184>
> e:[hidden email]<mailto:[hidden email]>
> w:http://edina.ac.uk
>
>
> The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
>
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]<mailto:[hidden email]>
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained athttp://sourceforge.net/projects/geonetwork
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced analytics on semi-structured data. The platform includes APIs for building apps and a phenomenal toolset for data science. Developers can use our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]<mailto:[hidden email]>
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained athttp://sourceforge.net/projects/geonetwork
>
>
>
>
> ------------------------------------------------------------------------------
> Precog is a next-generation analytics platform capable of advanced
> analytics on semi-structured data. The platform includes APIs for building
> apps and a phenomenal toolset for data science. Developers can use
> our toolset for easy data analysis & visualization. Get a free account!
> http://www2.precog.com/precogplatform/slashdotnewsletter
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]<mailto:[hidden email]>
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained athttp://sourceforge.net/projects/geonetwork
>
>
>
> --
> Geospatial Software Developer (Geo Services)
> EDINA
> Causewayside House
> 160 Causewayside
> Edinburgh EH9 1PR
>
> p: +44 (0)131 5601184
> e:[hidden email]<mailto:[hidden email]>
> w:http://edina.ac.uk
>
>
>

--
Geospatial Software Developer (Geo Services)
EDINA
Causewayside House
160 Causewayside
Edinburgh EH9 1PR

p: +44 (0)131 5601184
e:[hidden email]
w:http://edina.ac.uk


The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.


------------------------------------------------------------------------------
Introducing AppDynamics Lite, a free troubleshooting tool for Java/.NET
Get 100% visibility into your production application - at no cost.
Code-level diagnostics for performance bottlenecks with <2% overhead
Download for free and get started troubleshooting in minutes.
http://p.sf.net/sfu/appdyn_d2d_ap1
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Lionel Menard
Hi everyone,

**GeoNetwork Version:2.10.1 ** http://geocatalog.webservice-energy.org

I went on this interesting thread as I have trouble setting up a CSW harvest from my GeoNetwork to an ESRI Geoportal. At harvest set-up stage, I try to add "Search Criteria" to filter the harvest. We I do so, I'm not able to save this new entry. The save button does not work. If I do not add such "Search criteria" I can save the harvest target.

I need these "Search Criteria" as I don't want to harvest the whole huge content of the remote Geoportal.
For the same reason I've not yet try the harvest of the whole Geoportal.

Does anyone has the same pb. ?

Has someone successfully harvest a remote CSW ESRI Geoportal yet ?

Thanks in advance for your help.

Lionel


 
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Brent Wood
Hi Lionel,

We have had problems connecting to Geoportal.


We are developng a free Open Source tool for ESRI Arc Server to fix the lack of effective CSW support for ESRI geodabases.

It is a python based tool that harvests metadata from the geodabase and provides a CSW service (tested against Geometwork).

Hopefully this will allow ESRI users to have a valid CSW service with their ESRI system, and introduce them to Open Source as well :-)



On a related note - we have upgraded our Geonetwork catalogue at NIWA - which may have addressed some of the issues you had with it?



Cheers,

  Brent Wood



________________________________
 From: Lionel Menard <[hidden email]>
To: [hidden email]
Sent: Friday, November 22, 2013 11:18 PM
Subject: Re: [GeoNetwork-users] Geoportal issues
 

Hi everyone,

**GeoNetwork Version:2.10.1 ** http://geocatalog.webservice-energy.org

I went on this interesting thread as I have trouble setting up a CSW harvest
from my GeoNetwork to an ESRI Geoportal. At harvest set-up stage, I try to
add "Search Criteria" to filter the harvest. We I do so, I'm not able to
save this new entry. The save button does not work. If I do not add such
"Search criteria" I can save the harvest target.

I need these "Search Criteria" as I don't want to harvest the whole huge
content of the remote Geoportal.
For the same reason I've not yet try the harvest of the whole Geoportal.

Does anyone has the same pb. ?

Has someone successfully harvest a remote CSW ESRI Geoportal yet ?

Thanks in advance for your help.

Lionel






--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoportal-issues-tp5047261p5090611.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

marten
Hi all,

Esri Geoportal Server IS open source and provide OGC compliant CSW services. Geoportal Server does NOT require any Esri software license and works with services from Esri or with OGC services from other software.

We have a open source tool already that allows for registering metadata for files in file systems and and feature classes in geodatabases (personal, file, enterprise) with the Geoportal Server for exposing through CSW. Users of ArcGIS Server may also publish geodatabase services that Geoportal Server can index (along with all other ArcGIS Server service types including KML, W*S, and REST services).

We also have an open source CSW client for ArcGIS Desktop users that can connect to may flavors, versions, and brands of CSW (OGCCORE, APISO, ebRIM) and can be extended with custom profiles for specific catalogs.

You can fork, customize, and contribute to Geoportal Server at https://github.com/Esri/geoportal-server

And while you're at github, check out the 160 public repos (https://github.com/Esri) of other Esri open source tools, components, API, templates, SDK, and what have you.

Cheers,

@martenhogeweg


-----Original Message-----
From: Brent Wood [mailto:[hidden email]]
Sent: Friday, November 22, 2013 3:36 PM
To: Lionel Menard; [hidden email]
Subject: Re: [GeoNetwork-users] Geoportal issues

Hi Lionel,

We have had problems connecting to Geoportal.


We are developng a free Open Source tool for ESRI Arc Server to fix the lack of effective CSW support for ESRI geodabases.

It is a python based tool that harvests metadata from the geodabase and provides a CSW service (tested against Geometwork).

Hopefully this will allow ESRI users to have a valid CSW service with their ESRI system, and introduce them to Open Source as well :-)



On a related note - we have upgraded our Geonetwork catalogue at NIWA - which may have addressed some of the issues you had with it?



Cheers,

  Brent Wood



________________________________
 From: Lionel Menard <[hidden email]>
To: [hidden email]
Sent: Friday, November 22, 2013 11:18 PM
Subject: Re: [GeoNetwork-users] Geoportal issues
 

Hi everyone,

**GeoNetwork Version:2.10.1 ** http://geocatalog.webservice-energy.org

I went on this interesting thread as I have trouble setting up a CSW harvest
from my GeoNetwork to an ESRI Geoportal. At harvest set-up stage, I try to
add "Search Criteria" to filter the harvest. We I do so, I'm not able to
save this new entry. The save button does not work. If I do not add such
"Search criteria" I can save the harvest target.

I need these "Search Criteria" as I don't want to harvest the whole huge
content of the remote Geoportal.
For the same reason I've not yet try the harvest of the whole Geoportal.

Does anyone has the same pb. ?

Has someone successfully harvest a remote CSW ESRI Geoportal yet ?

Thanks in advance for your help.

Lionel






--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoportal-issues-tp5047261p5090611.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork


------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Brent Wood
Without getting into a debate about the standards support (or lack) of various implementations of OGC services in various implementations - there are plenty of examples of poor interoperability - and not just from proprietary implementations... but I know of no (yes ZERO) institutions who have implemented a working ESRI geoportal without some painful issues to work through. I'm not saying there are none - just none I know of.

Even the ESRI developers we are working with wanted the new tool to be open source licenced so that other ESRI users could benefit, so I assume others I don't know of would also benefit..

I would hope the ESRI community will welcome having a choice of open source tools in this area to enable them to reliably participate in a federated, open standards based metadata network.

Brent Wood




________________________________
 From: Marten Hogeweg <[hidden email]>
To: Brent Wood <[hidden email]>; Lionel Menard <[hidden email]>; "[hidden email]" <[hidden email]>
Sent: Saturday, November 23, 2013 12:46 PM
Subject: RE: [GeoNetwork-users] Geoportal issues
 

Hi all,

Esri Geoportal Server IS open source and provide OGC compliant CSW services. Geoportal Server does NOT require any Esri software license and works with services from Esri or with OGC services from other software.

We have a open source tool already that allows for registering metadata for files in file systems and and feature classes in geodatabases (personal, file, enterprise) with the Geoportal Server for exposing through CSW. Users of ArcGIS Server may also publish geodatabase services that Geoportal Server can index (along with all other ArcGIS Server service types including KML, W*S, and REST services).

We also have an open source CSW client for ArcGIS Desktop users that can connect to may flavors, versions, and brands of CSW (OGCCORE, APISO, ebRIM) and can be extended with custom profiles for specific catalogs.

You can fork, customize, and contribute to Geoportal Server at https://github.com/Esri/geoportal-server

And while you're at github, check out the 160 public repos (https://github.com/Esri) of other Esri open source tools, components, API, templates, SDK, and what have you.

Cheers,

@martenhogeweg


-----Original Message-----
From: Brent Wood [mailto:[hidden email]]
Sent: Friday, November 22, 2013 3:36 PM
To: Lionel Menard; [hidden email]
Subject: Re: [GeoNetwork-users] Geoportal issues

Hi Lionel,

We have had problems connecting to Geoportal.


We are developng a free Open Source tool for ESRI Arc Server to fix the lack of effective CSW support for ESRI geodabases.

It is a python based tool that harvests metadata from the geodabase and provides a CSW service (tested against Geometwork).

Hopefully this will allow ESRI users to have a valid CSW service with their ESRI system, and introduce them to Open Source as well :-)



On a related note - we have upgraded our Geonetwork catalogue at NIWA - which may have addressed some of the issues you had with it?



Cheers,

  Brent Wood



________________________________
From: Lionel Menard <[hidden email]>
To: [hidden email]
Sent: Friday, November 22, 2013 11:18 PM
Subject: Re: [GeoNetwork-users] Geoportal issues


Hi everyone,

**GeoNetwork Version:2.10.1 ** http://geocatalog.webservice-energy.org

I went on this interesting thread as I have trouble setting up a CSW harvest
from my GeoNetwork to an ESRI Geoportal. At harvest set-up stage, I try to
add "Search Criteria" to filter the harvest. We I do so, I'm not able to
save this new entry. The save button does not work. If I do not add such
"Search criteria" I can save the harvest target.

I need these "Search Criteria" as I don't want to harvest the whole huge
content of the remote Geoportal.
For the same reason I've not yet try the harvest of the whole Geoportal.

Does anyone has the same pb. ?

Has someone successfully harvest a remote CSW ESRI Geoportal yet ?

Thanks in advance for your help.

Lionel






--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoportal-issues-tp5047261p5090611.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

SimonPigot
In reply to this post by Brent Wood
For sure an OGC CSW service would be best, but I guess you tried the GeoPortal havester in GeoNetwork 2.10.x?

http://geonetwork-opensource.org/manuals/2.10.2/eng/users/managing_metadata/harvesting/geoPREST/index.html#geoportal-rest-harvester

Cheers,
Simon
________________________________________
From: Brent Wood [[hidden email]]
Sent: Saturday, 23 November 2013 10:36 AM
To: Lionel Menard; [hidden email]
Subject: Re: [GeoNetwork-users] Geoportal issues

Hi Lionel,

We have had problems connecting to Geoportal.


We are developng a free Open Source tool for ESRI Arc Server to fix the lack of effective CSW support for ESRI geodabases.

It is a python based tool that harvests metadata from the geodabase and provides a CSW service (tested against Geometwork).

Hopefully this will allow ESRI users to have a valid CSW service with their ESRI system, and introduce them to Open Source as well :-)



On a related note - we have upgraded our Geonetwork catalogue at NIWA - which may have addressed some of the issues you had with it?



Cheers,

  Brent Wood



________________________________
 From: Lionel Menard <[hidden email]>
To: [hidden email]
Sent: Friday, November 22, 2013 11:18 PM
Subject: Re: [GeoNetwork-users] Geoportal issues


Hi everyone,

**GeoNetwork Version:2.10.1 ** http://geocatalog.webservice-energy.org

I went on this interesting thread as I have trouble setting up a CSW harvest
from my GeoNetwork to an ESRI Geoportal. At harvest set-up stage, I try to
add "Search Criteria" to filter the harvest. We I do so, I'm not able to
save this new entry. The save button does not work. If I do not add such
"Search criteria" I can save the harvest target.

I need these "Search Criteria" as I don't want to harvest the whole huge
content of the remote Geoportal.
For the same reason I've not yet try the harvest of the whole Geoportal.

Does anyone has the same pb. ?

Has someone successfully harvest a remote CSW ESRI Geoportal yet ?

Thanks in advance for your help.

Lionel






--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoportal-issues-tp5047261p5090611.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Brent Wood
Gidday Simon,

We did consider Geonetwork based solutions, but we are working with other institutions looking at non-Geonetwork catalogues as well as QGIS usres using CSW plugins, so rather than having Geonetwork able to interoperate with Geoportal, we believed it was a better way forward to enable ESRI (Arc Server) users to work robustly within a CSW federation.


Cheers,

  Brent



________________________________
 From: "[hidden email]" <[hidden email]>
To: [hidden email]; [hidden email]; [hidden email]
Sent: Saturday, November 23, 2013 3:12 PM
Subject: RE: [GeoNetwork-users] Geoportal issues
 

For sure an OGC CSW service would be best, but I guess you tried the GeoPortal havester in GeoNetwork 2.10.x?

http://geonetwork-opensource.org/manuals/2.10.2/eng/users/managing_metadata/harvesting/geoPREST/index.html#geoportal-rest-harvester

Cheers,
Simon
________________________________________

From: Brent Wood [[hidden email]]
Sent: Saturday, 23 November 2013 10:36 AM
To: Lionel Menard; [hidden email]
Subject: Re: [GeoNetwork-users] Geoportal issues

Hi Lionel,

We have had problems connecting to Geoportal.


We are developng a free Open Source tool for ESRI Arc Server to fix the lack of effective CSW support for ESRI geodabases.

It is a python based tool that harvests metadata from the geodabase and provides a CSW service (tested against Geometwork).

Hopefully this will allow ESRI users to have a valid CSW service with their ESRI system, and introduce them to Open Source as well :-)



On a related note - we have upgraded our Geonetwork catalogue at NIWA - which may have addressed some of the issues you had with it?



Cheers,

  Brent Wood



________________________________
From: Lionel Menard <[hidden email]>
To: [hidden email]
Sent: Friday, November 22, 2013 11:18 PM
Subject: Re: [GeoNetwork-users] Geoportal issues


Hi everyone,

**GeoNetwork Version:2.10.1 ** http://geocatalog.webservice-energy.org

I went on this interesting thread as I have trouble setting up a CSW harvest
from my GeoNetwork to an ESRI Geoportal. At harvest set-up stage, I try to
add "Search Criteria" to filter the harvest. We I do so, I'm not able to
save this new entry. The save button does not work. If I do not add such
"Search criteria" I can save the harvest target.

I need these "Search Criteria" as I don't want to harvest the whole huge
content of the remote Geoportal.
For the same reason I've not yet try the harvest of the whole Geoportal.

Does anyone has the same pb. ?

Has someone successfully harvest a remote CSW ESRI Geoportal yet ?

Thanks in advance for your help.

Lionel






--
View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoportal-issues-tp5047261p5090611.html
Sent from the GeoNetwork users mailing list archive at Nabble.com.

------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Lionel Menard
Dear Marten, Brent and Simon, dear list,

thanks a lot for the comments, solutions, (and related note ;-)).

@Simon: No I did not test this feature yet. I will for sure and provide feedback.

@Marten and Brent. Thanks for your experiences feedback and clarification. I think this need to be a win win solution here. The more platform available the more dynamic the domain might be (No "Yoda" talk here :-) ). Of course we need to manage this cross-platform interoperability but pb. also occurs between the various versions of a given platform. So lets try to smooth that out.

I'm gonna get my hand back in the Geoportal Harvester option right now and hopefully provide you with successful feedback.

Thanks again to you all for your commitment.

Cheers,

Lionel
 

 
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Jacqueline Mize - NOAA Affiliate
I have had great success with our geoportal instances. I currently have
three implementations. Marten and team have been extremely helpful anytime
I hit a small snag. I'd be happy to demo any of our geoportals to you.
Check this one out
http://www.match.globalchange.gov/geoportal/catalog/main/home.page


On Mon, Nov 25, 2013 at 10:48 AM, Lionel Menard <
[hidden email]> wrote:

> Dear Marten, Brent and Simon, dear list,
>
> thanks a lot for the comments, solutions, (and related note ;-)).
>
> @Simon: No I did not test this feature yet. I will for sure and provide
> feedback.
>
> @Marten and Brent. Thanks for your experiences feedback and clarification.
> I
> think this need to be a win win solution here. The more platform available
> the more dynamic the domain might be (No "Yoda" talk here :-) ). Of course
> we need to manage this cross-platform interoperability but pb. also occurs
> between the various versions of a given platform. So lets try to smooth
> that
> out.
>
> I'm gonna get my hand back in the Geoportal Harvester option right now and
> hopefully provide you with successful feedback.
>
> Thanks again to you all for your commitment.
>
> Cheers,
>
> Lionel
>
>
>
>
>
>
>
> --
> View this message in context:
> http://osgeo-org.1560.x6.nabble.com/Geoportal-issues-tp5047261p5091066.html
> Sent from the GeoNetwork users mailing list archive at Nabble.com.
>
>
> ------------------------------------------------------------------------------
> Shape the Mobile Experience: Free Subscription
> Software experts and developers: Be at the forefront of tech innovation.
> Intel(R) Software Adrenaline delivers strategic insight and game-changing
> conversations that shape the rapidly evolving mobile landscape. Sign up
> now.
> http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
> _______________________________________________
> GeoNetwork-users mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/geonetwork-users
> GeoNetwork OpenSource is maintained at
> http://sourceforge.net/projects/geonetwork
>



--
Jacqueline Mize
Metadata Specialist
Radiance Technologies, Inc.
DOC/NOAA/NESDIS/NODC/NCDDC
1021 Balch Blvd, Suite 1003
Stennis Space Center, MS 39529
email: [hidden email]
ph: 228.688.2174
------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

Lionel Menard
Hi everyone,
thanks Jacqueline for your testimony. Unfortunately implementing is one thing and harvesting between implementations is an other thing...Have you had any successful harvest from GeoNetwork to Geoportal you could report ?
@Simon: I tested the Geoportal Harvester with the help of the link you provide. The target version is:
ArcGIS Server Geoportal Extension 10 - OGC CSW 2.0.2 ISO AP
Unfortunately this still does not work.
I set one keyword for Search Criteria: (solar)
I tested with both XSTL options set to: Add-gmd-prefix and gmiTogmd. Same results.
From the "History" link in the "Harvest Manager" section I get the following message: "Harvested Nothing".
I also get this message in the log:
2013-11-25 18:36:34,862 WARN  [geonetwork.harvester] - Skipped record not in supported format

I also did the test with the example Geoportal of the doc you provide:
http://www.ngdc.noaa.gov/geoportal

Same behavior...

Any thoughts about what's going wrong ?

Lionel



Reply | Threaded
Open this post in threaded view
|

Re: Geoportal issues

marten
Our sandbox site at http://gptogc.esri.com regularly harvests from a variety of catalogs including several GeoNetwork implementations. Here is a list: http://gptogc.esri.com/geoportal/rest/repositories



One of these is the web services energy site:

http://geocatalog.webservice-energy.org/geonetwork/srv/eng/csw?SERVICE=CSW&VERSION=2.0.2&REQUEST=GetCapabilities



below is a screenshot of the harvesting results for this catalog. What you see here is that out of the 907 records the last harvest validated and published 777. This illustrates one possible challenge: different catalogs may implement different validation rules for metadata (see second screenshot for a piece of a detailed harvesting report).



Another issue I have seen many times is in the registration itself where we require the CSW to have a title in the capabilities statement. Many GeoNetwork CSW don't have this and without that you won't get through the registration process. This even holds for significant CSW like the GEOSS clearinghouse:

http://ec2-50-19-223-225.compute-1.amazonaws.com/geonetwork/srv/en/csw?request=GetCapabilities&service=CSW&version=2.0.2

what I then do is rehost the capabilities file as a straight XML file and register that with geoportal as a proxy for the actual CSW. The above is available here:

https://dl.dropboxusercontent.com/u/14831068/cswproxy/geoss_clearinghouse.xml



Furthermore: different CSW respond differently. For example the NIWA (New Zealand) catalog responds with ISO metadata in a different namespace

http://dc.niwa.co.nz/niwa_dc/srv/eng/main.home

http://dc.niwa.co.nz/niwa_dc/srv/eng/csw?service=CSW&request=GetRecordById&version=2.0.2&ElementSetName=full&OutputSchema=csw:IsoRecord&ID=c583f085-f2aa-42fd-a1ac-076703d09dde
mcp:MD_Metadata xmlns:mcp="http://bluenet3.antcrc.utas.edu.au/mcp"


that means we have to update our profiles of GeoNetwork CSW interaction when we see these things.





[cid:image002.jpg@01CEE9CB.D491A230]



[cid:image004.jpg@01CEE9CB.D491A230]





-----Original Message-----
From: Lionel Menard [mailto:[hidden email]]
Sent: Monday, November 25, 2013 10:17 AM
To: [hidden email]
Subject: Re: [GeoNetwork-users] Geoportal issues



Hi everyone,

thanks Jacqueline for your testimony. Unfortunately implementing is one thing and harvesting between implementations is an other thing...Have you had any successful harvest from GeoNetwork to Geoportal you could report ?

@Simon: I tested the Geoportal Harvester with the help of the link you provide. The target version is:

ArcGIS Server Geoportal Extension 10 - OGC CSW 2.0.2 ISO AP Unfortunately this still does not work.

I set one keyword for Search Criteria: (solar) I tested with both XSTL options set to: Add-gmd-prefix and gmiTogmd. Same results.

>From the "History" link in the "Harvest Manager" section I get the

>following

message: "Harvested Nothing".

I also get this message in the log:

2013-11-25 18:36:34,862 WARN  [geonetwork.harvester] - Skipped record not in supported format



I also did the test with the example Geoportal of the doc you provide:

http://www.ngdc.noaa.gov/geoportal



Same behavior...



Any thoughts about what's going wrong ?



Lionel















--

View this message in context: http://osgeo-org.1560.x6.nabble.com/Geoportal-issues-tp5047261p5091082.html

Sent from the GeoNetwork users mailing list archive at Nabble.com.



------------------------------------------------------------------------------

Shape the Mobile Experience: Free Subscription Software experts and developers: Be at the forefront of tech innovation.

Intel(R) Software Adrenaline delivers strategic insight and game-changing conversations that shape the rapidly evolving mobile landscape. Sign up now.

http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk

_______________________________________________

GeoNetwork-users mailing list

[hidden email]<mailto:[hidden email]>

https://lists.sourceforge.net/lists/listinfo/geonetwork-users

GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork



------------------------------------------------------------------------------
Shape the Mobile Experience: Free Subscription
Software experts and developers: Be at the forefront of tech innovation.
Intel(R) Software Adrenaline delivers strategic insight and game-changing
conversations that shape the rapidly evolving mobile landscape. Sign up now.
http://pubads.g.doubleclick.net/gampad/clk?id=63431311&iu=/4140/ostg.clktrk
_______________________________________________
GeoNetwork-users mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-users
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork

image002.jpg (68K) Download Attachment
image004.jpg (75K) Download Attachment
12