New Metadata Schema

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|

New Metadata Schema

fsc7
Hello List,

I'm trying to use Geonetwork to manage a different Metadata Schema. I searched the list historic and I found Paul Grzeszczak that has made an adaptation to work with EML.
I want to know what are the steps that I should follow to customize my own dataset. The problem is that I already have a system that manage this Metadata and it's based on FGDC, but has some other fields. I'm wanting to migrate all this data to Geonetwork but I can't loose this data.

Thanks in advance and sorry about my english,

Felipe


"Se o Senhor não constrói a casa, em vão trabalham os construtores” (Sl 127,1)


Yahoo! Acesso Grátis - Internet rápida e grátis. Instale o discador agora!
Reply | Threaded
Open this post in threaded view
|

Re: New Metadata Schema

Jo Walsh
dear Felipe, all,
On Thu, Sep 28, 2006 at 07:47:26PM +0000, Felipe Costa wrote:
> I'm trying to use Geonetwork to manage a different Metadata Schema.
> I searched the list historic and I found Paul Grzeszczak that has
> made an adaptation to work with EML.
> I want to know what are the steps that I should follow to customize
> my own dataset. The problem is that I already have a system that
> manage this Metadata and it's based on FGDC, but has some other
> fields. I'm wanting to migrate all this data to Geonetwork but I
> can't loose this data.

I would like to +1 on this very much. At OSGeo we've also been working
with a custom metadata schema derived from FGDC with additional
properties describing file formats and OGC web services.
http://wiki.osgeo.org/index.php/Geodata_Metadata_Model <- overview

I am really keen to make use of the catalog publishing capacities of
GeoNetwork - bleeding edge CSW support, etc - but to be able to keep
using this metadata model (which maps to a PostGIS database)
underneath. Rather than wanting to "migrate" in one shot, it would be
wonderful if it were possible to "migrate" in real time by
establishing a map of what GeoNetwork thinks of as ISO properties to
what a different user base thinks of as FGDC properties.

The GeoTools toolkit contains some nice metadata model abstraction
interfaces - cf Jody Garnett's recent explication at
https://geodata.osgeo.org/servlets/ReadMsg?list=geodata&msgNo=232
from the client-side, metadata-reuse perpective this is good stuff.

If there are GeoNetwork user needs to migrate from one (reasonably)
well-known metadata model to another - it would be wonderful to be
able to put the effort into developing a common abstraction which
would enable people either to port data over to the GeoNetwork schema
or to be able to use their own data stores with a GeoNetwork frontend
- at least for the CSW/OAI-PMH/etc publishing parts if not for the
forms-based metadata-entry parts...

I hope this makes sense, and hope that others have more pragmatic
answers for you :)

cheers,


jo
 


Reply | Threaded
Open this post in threaded view
|

Re: New Metadata Schema

Pierre LAGARDE
In reply to this post by fsc7

Hi Felipe,

We had the same problem to adapt GN for the french profil 19115.
2 solutions:
        1/ You try to include directly your XML metadata file in GN
database. But, after, you need to develop specific access to this XML files
and change all XSL files. Not sure to guarantee the compatibility with the
evolution of GN !
        2 / You modify the actual 19115 schema in GN and you implement an
XSL transformation (specific impot) to import your XML files in the GN 19115
schema.

To add some fields in GN, you need to have some skills in the use of XSD
schema. Go to [directory of GN]/xml/schemas/iso19115 and open the schema.xsd
file. If you want to add one field, you only add the adequate xs:element
(;-)…. In the majority of the cases, the field should be displayed in the
advanced view..  

For example, we have a new Citation inside the DataIdentification. We add
<xs:element ref="frCitation" minOccurs="0" maxOccurs="unbounded"/> inside
the DataIdent.

Next, you have to implement a specific XSL transformation.. See the example
in migrate directory (to transform 19115 to 19139 files).

I hope that this mail will give you a beginning of a solution…


Pierre.




________________________________________
De : [hidden email]
[mailto:[hidden email]] De la part de Felipe
Costa
Envoyé : jeudi 28 septembre 2006 21:47
À : [hidden email]
Objet : [GeoNetwork-devel] New Metadata Schema

Hello List,

I'm trying to use Geonetwork to manage a different Metadata Schema. I
searched the list historic and I found Paul Grzeszczak that has made an
adaptation to work with EML.
I want to know what are the steps that I should follow to customize my own
dataset. The problem is that I already have a system that manage this
Metadata and it's based on FGDC, but has some other fields. I'm wanting to
migrate all this data to Geonetwork but I can't loose this data.

Thanks in advance and sorry about my english,

Felipe


"Se o Senhor não constrói a casa, em vão trabalham os construtores” (Sl
127,1)
 
________________________________________
Yahoo! Acesso Grátis - Internet rápida e grátis. Instale o discador agora!
--
Ce message a ete verifie par MailScanner pour des virus ou des polluriels et
rien de suspect n'a ete trouve.
 
Les donnees et renseignements contenus dans ce message sont personnels,
confidentiels et privés.Toute publication, utilisation ou diffusion, meme
partielle, doit etre autorisee.
 
Any data and information contained in this electronic mail is personal,
confidential and private. Any total or partial publication, use or
distribution must be authorized.


--
Ce message a ete verifie par MailScanner pour des virus ou des polluriels et rien de suspect n'a ete trouve.

Les donnees et renseignements contenus dans ce message sont personnels, confidentiels et prives. Toute publication, utilisation ou diffusion, meme partielle, doit etre autorisee.

Any data and information contained in this electronic mail is personal, confidential and secret. Any total or partial publication, use or distribution must be authorized.



Reply | Threaded
Open this post in threaded view
|

Re: New Metadata Schema

Jeroen Ticheler-3
Hi all,

On Sep 29, 2006, at 8:41 AM, Pierre LAGARDE wrote:

>
> Hi Felipe,
>
> We had the same problem to adapt GN for the french profil 19115.
> 2 solutions:
> 1/ You try to include directly your XML metadata file in GN
> database. But, after, you need to develop specific access to this  
> XML files
> and change all XSL files. Not sure to guarantee the compatibility  
> with the
> evolution of GN !

This is the way to achieve it the clean way, but is in fact quite a  
lot of work.

> 2 / You modify the actual 19115 schema in GN and you implement an
> XSL transformation (specific impot) to import your XML files in the  
> GN 19115
> schema.

This is a reasonable alternative if the alternative model has good  
mapping to the ISO, FGDC or DC fields. I think that import and export  
through an XSL transformation is one of the most powerful ways of  
supporting multiple closely related content models.

>
> To add some fields in GN, you need to have some skills in the use  
> of XSD
> schema. Go to [directory of GN]/xml/schemas/iso19115 and open the  
> schema.xsd
> file. If you want to add one field, you only add the adequate  
> xs:element
> (;-)…. In the majority of the cases, the field should be displayed  
> in the
> advanced view..

This can be customized by adapting the XSL responsible for the  
default view so that they are also visualized in the default view.

Ciao,
Jeroen

>
> For example, we have a new Citation inside the DataIdentification.  
> We add
> <xs:element ref="frCitation" minOccurs="0" maxOccurs="unbounded"/>  
> inside
> the DataIdent.
>
> Next, you have to implement a specific XSL transformation.. See the  
> example
> in migrate directory (to transform 19115 to 19139 files).
>
> I hope that this mail will give you a beginning of a solution…
>
>
> Pierre.
>
>
>
>
> ________________________________________
> De : [hidden email]
> [mailto:[hidden email]] De la part  
> de Felipe
> Costa
> Envoyé : jeudi 28 septembre 2006 21:47
> À : [hidden email]
> Objet : [GeoNetwork-devel] New Metadata Schema
>
> Hello List,
>
> I'm trying to use Geonetwork to manage a different Metadata Schema. I
> searched the list historic and I found Paul Grzeszczak that has  
> made an
> adaptation to work with EML.
> I want to know what are the steps that I should follow to customize  
> my own
> dataset. The problem is that I already have a system that manage this
> Metadata and it's based on FGDC, but has some other fields. I'm  
> wanting to
> migrate all this data to Geonetwork but I can't loose this data.
>
> Thanks in advance and sorry about my english,
>
> Felipe
>
>
> "Se o Senhor não constrói a casa, em vão trabalham os  
> construtores” (Sl
> 127,1)
>
> ________________________________________
> Yahoo! Acesso Grátis - Internet rápida e grátis. Instale o discador  
> agora!
> --
> Ce message a ete verifie par MailScanner pour des virus ou des  
> polluriels et
> rien de suspect n'a ete trouve.
>
> Les donnees et renseignements contenus dans ce message sont  
> personnels,
> confidentiels et privés.Toute publication, utilisation ou  
> diffusion, meme
> partielle, doit etre autorisee.
>
> Any data and information contained in this electronic mail is  
> personal,
> confidential and private. Any total or partial publication, use or
> distribution must be authorized.
>
>
> --
> Ce message a ete verifie par MailScanner pour des virus ou des  
> polluriels et rien de suspect n'a ete trouve.
>
> Les donnees et renseignements contenus dans ce message sont  
> personnels, confidentiels et prives. Toute publication, utilisation  
> ou diffusion, meme partielle, doit etre autorisee.
>
> Any data and information contained in this electronic mail is  
> personal, confidential and secret. Any total or partial  
> publication, use or distribution must be authorized.
>
>
> ----------------------------------------------------------------------
> ---
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to  
> share your
> opinions on IT & business topics through brief surveys -- and earn  
> cash
> http://www.techsay.com/default.php?
> page=join.php&p=sourceforge&CID=DEVDEV
> _______________________________________________
> GeoNetwork-devel mailing list
> [hidden email]
> https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
> GeoNetwork OpenSource is maintained at http://sourceforge.net/ 
> projects/geonetwork

Reply | Threaded
Open this post in threaded view
|

Re: New Metadata Schema

fsc7
In reply to this post by fsc7
Hello,

Thanks for all your quick answers. And sorry for my late reply.
I'm still reading the documentation you all sent to me. And many things are still confusing to me. But it will be solved and I hope to help the project somehow. Maybe documentig the results of my work.

Thanks again,

Felipe

PS: A suggestion, I've installed first my geonetwork with mckoi database, after that I changed to mysql manually using the configuration files.
My little suggestion is to use auto_increment in the id attributes.

 
"Se o Senhor não constrói a casa, em vão trabalham os construtores (Sl 127,1)
Reply | Threaded
Open this post in threaded view
|

Re: New Metadata Schema

crayco
In reply to this post by fsc7
I created an howto add schema's to Geonetwork...
It's very useful to make sure you don't forget any piece of code.
I posted-it here : http://www.nabble.com/Howto-Adding---making-a-new-metadata-schema-tf3990416s18419.html

Tough it might be useful!
crayco
Reply | Threaded
Open this post in threaded view
|

Re: New Metadata Schema

zer0mode
This post was updated on .
I've been after some information about adding schemas in GN and I found this
old bearded thread.
I'll append the correct link since the one from crayco doesn't work and let the giant sleep in peace.

http://osgeo-org.1560.x6.nabble.com/Howto-Adding-making-a-new-metadata-schema-td3879680.html


--
Sent from: http://osgeo-org.1560.x6.nabble.com/GeoNetwork-developer-f3874395.html

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
GeoNetwork-devel mailing list
GeoNetwork-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: New Metadata Schema

Jose Garcia
Hi

The manual already contains a section for this, although probably not totally updated: https://geonetwork-opensource.org/manuals/3.4.x/en/customizing-application/implementing-a-schema-plugin.html


Also you can try https://github.com/josegar74/generator-geonetwork-metadata-schema, a Yeoman generator that creates the basic structure for metadata schemas based in iso19139. It helps to get the main files required for a new schema, so can be a good starting point to create new schemas. I try to maintain it updated, but use it on your own risk.

Regards,
Jose García


On Wed, Jul 18, 2018 at 3:38 PM, zer0mode <[hidden email]> wrote:
I've been after some information about adding schemas in GN and I found this
old bearded thread.
I'll append the correct link since the one from  crayco
<http://osgeo-org.1560.x6.nabble.com/template/NamlServlet.jtp?macro=user_nodes&user=199701
doesn't work and let the giant sleep in peace.

http://osgeo-org.1560.x6.nabble.com/Howto-Adding-making-a-new-metadata-schema-td3879680.html



--
Sent from: http://osgeo-org.1560.x6.nabble.com/GeoNetwork-developer-f3874395.html

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork



--
Vriendelijke groeten / Kind regards,

Jose García


Veenderweg 13
6721 WD Bennekom
The Netherlands
T: <a href="tel:+31318416664" style="font-family:Helvetica,Arial,sans-serif" target="_blank">+31 (0)318 416664

  

Please consider the environment before printing this email.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: New Metadata Schema

zer0mode
Hi Jose !

Thanks, url bookmarked !

I've installed the tool. First generation test was successful, but I haven't
succeeded to integrate the schema into GN 3.4.2.  eml-gbif
<https://github.com/geonetwork/schema-plugins/tree/develop/eml-gbif>   is
old now and I try to make an update. I don't know how to incorporate the
EML
<http://www.dcc.ac.uk/resources/metadata-standards/eml-ecological-metadata-language>  
into the structure generated by your tool.

Additionally, is it necessary to rebuild the GN or more precise in which
cases is it required to rebuild it ?
What about the the plug-in code generation - this is the jar part, right ?

I also found Jo's guides -  same procedure
<https://github.com/AstunTechnology/iso19139.gemini22_GN3>   is used for
each schema available at this repo; also described in the README.md /(1)/ in
generated module.

Do those steps sound ok ?
- Generate metadata schema /module/ with the generator
- Integrate the new schema module into GN following the procedure above
/(1)/

What would be your approach to make that work correclty?



--
Sent from: http://osgeo-org.1560.x6.nabble.com/GeoNetwork-developer-f3874395.html

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: New Metadata Schema

Jose Garcia
Hi

See feedback inline.

Regards,
Jose García

On Mon, Jul 23, 2018 at 5:42 PM, zer0mode <[hidden email]> wrote:
Hi Jose !

Thanks, url bookmarked !

I've installed the tool. First generation test was successful, but I haven't
succeeded to integrate the schema into GN 3.4.2.  eml-gbif
<https://github.com/geonetwork/schema-plugins/tree/develop/eml-gbif>   is
old now and I try to make an update. I don't know how to incorporate the
EML
<http://www.dcc.ac.uk/resources/metadata-standards/eml-ecological-metadata-language
into the structure generated by your tool.


Note that https://github.com/geonetwork/schema-plugins/tree/develop/eml-gbif is not an iso19139 schema and the generator is intended to create the structure for new schemas based in iso19139, delegating most of the stuff to iso19139.

Probably you can use it for this other schema, but will require quite changes.

For this case, I would check with the manual  https://geonetwork-opensource.org/manuals/3.4.x/en/customizing-application/implementing-a-schema-plugin.html and try to upgrade it to 3.4.x version manually the current schema. I'm afraid anyway will take a bit as will require some time for test/fix.
 
Additionally, is it necessary to rebuild the GN or more precise in which
cases is it required to rebuild it ?
What about the the plug-in code generation - this is the jar part, right ?

The Java code in most cases is not required. Can be required if your schema extends iso19139 adding new namespaces/elements. 

But if your schema uses same xsd as iso19139 with same namespaces (for example https://github.com/AstunTechnology/iso19139.gemini22_GN3), the Java part is not required.




I also found Jo's guides -  same procedure
<https://github.com/AstunTechnology/iso19139.gemini22_GN3>   is used for
each schema available at this repo; also described in the README.md /(1)/ in
generated module. 

Do those steps sound ok ?
- Generate metadata schema /module/ with the generator
- Integrate the new schema module into GN following the procedure above
/(1)/

What would be your approach to make that work correclty?

Yes, that sounds fine, but see my previous comment about https://github.com/geonetwork/schema-plugins/tree/develop/eml-gbif , not sure if the generator will be much useful in this case. 




--
Sent from: http://osgeo-org.1560.x6.nabble.com/GeoNetwork-developer-f3874395.html

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork



--
Vriendelijke groeten / Kind regards,

Jose García


Veenderweg 13
6721 WD Bennekom
The Netherlands
T: <a href="tel:+31318416664" style="font-family:Helvetica,Arial,sans-serif" target="_blank">+31 (0)318 416664

  

Please consider the environment before printing this email.

------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork