Migrating large number of layers to Geonode

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Migrating large number of layers to Geonode

Sacha Black

hi list,

I am new to GeoNode and interested in migrating a large number of layers (> 3000)  from an old Mapserver 6.x WMS server. They are mostly shapefiles and some rasters.

I know I can connect to the existing WMS service to use the layers in GeoNode, but since eventually the old server will be turned off, I would like to know the best option to import the layers into GeoNode permanently.

I set up a basic GeoNode in a clean Ubuntu 16.04 install using the Quick Guide (http://geonode.org/#install). But I didn't find any specific instructions for setting up a bulk import.

Is there any examples of using a script to do this kind of task? Is this a reasonable expectation? What warnings/best practices should I be aware of?

- Sacha





_______________________________________________
geonode-users mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/geonode-users
Reply | Threaded
Open this post in threaded view
|

Re: Migrating large number of layers to Geonode

Alessio Fabiani-2
You can try to use the following module

This management command should walk through a spatialdata set of files (either raster and vector) and import them on GeoNode and GeoServer with a default initial configuration.

You still have to edit the metadata manually on a later step.


Regards,

Alessio Fabiani

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani

@alfa7691
Founder/Technical Lead


GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
Italy
phone: +39 0584 962313
fax:     +39 0584 1660272
mob:   +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.


On Tue, Dec 19, 2017 at 11:32 PM, Sacha Black <[hidden email]> wrote:

hi list,

I am new to GeoNode and interested in migrating a large number of layers (> 3000)  from an old Mapserver 6.x WMS server. They are mostly shapefiles and some rasters.

I know I can connect to the existing WMS service to use the layers in GeoNode, but since eventually the old server will be turned off, I would like to know the best option to import the layers into GeoNode permanently.

I set up a basic GeoNode in a clean Ubuntu 16.04 install using the Quick Guide (http://geonode.org/#install). But I didn't find any specific instructions for setting up a bulk import.

Is there any examples of using a script to do this kind of task? Is this a reasonable expectation? What warnings/best practices should I be aware of?

- Sacha





_______________________________________________
geonode-users mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/geonode-users



_______________________________________________
geonode-users mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/geonode-users
Reply | Threaded
Open this post in threaded view
|

Re: Migrating large number of layers to Geonode

Sacha Black
Thank you - I will try it.

If I prepare metadata and cartography (SLD) in advance, will the script import them also?

If yes, what format should the metadata be? I have the old metadata in a GeoNetwork, and can export and transform however is necessary.

If no, I will just edit the metadata afterwards as advised.

- Sacha

On Wed, Dec 20, 2017 at 12:46 AM, Alessio Fabiani <[hidden email]> wrote:
You can try to use the following module

This management command should walk through a spatialdata set of files (either raster and vector) and import them on GeoNode and GeoServer with a default initial configuration.

You still have to edit the metadata manually on a later step.


Regards,

Alessio Fabiani

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani

@alfa7691
Founder/Technical Lead


GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
Italy
phone: <a href="tel:+39%200584%20962313" value="+390584962313" target="_blank">+39 0584 962313
fax:     <a href="tel:+39%200584%20166%200272" value="+3905841660272" target="_blank">+39 0584 1660272
mob:   <a href="tel:+39%20331%20623%203686" value="+393316233686" target="_blank">+39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.


On Tue, Dec 19, 2017 at 11:32 PM, Sacha Black <[hidden email]> wrote:

hi list,

I am new to GeoNode and interested in migrating a large number of layers (> 3000)  from an old Mapserver 6.x WMS server. They are mostly shapefiles and some rasters.

I know I can connect to the existing WMS service to use the layers in GeoNode, but since eventually the old server will be turned off, I would like to know the best option to import the layers into GeoNode permanently.

I set up a basic GeoNode in a clean Ubuntu 16.04 install using the Quick Guide (http://geonode.org/#install). But I didn't find any specific instructions for setting up a bulk import.

Is there any examples of using a script to do this kind of task? Is this a reasonable expectation? What warnings/best practices should I be aware of?

- Sacha





_______________________________________________
geonode-users mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/geonode-users




_______________________________________________
geonode-users mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/geonode-users
Reply | Threaded
Open this post in threaded view
|

Re: Migrating large number of layers to Geonode

Alessio Fabiani-2
If you attach to the files .sld and .xml with the same name it should import them also.

It is worth to make a try.

.xml better if are ISO 8601 compliant, but it should accept Dublin Core too.


Regards,

Alessio Fabiani

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani

@alfa7691
Founder/Technical Lead


GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
Italy
phone: +39 0584 962313
fax:     +39 0584 1660272
mob:   +39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.


On Wed, Dec 20, 2017 at 3:34 PM, Sacha Black <[hidden email]> wrote:
Thank you - I will try it.

If I prepare metadata and cartography (SLD) in advance, will the script import them also?

If yes, what format should the metadata be? I have the old metadata in a GeoNetwork, and can export and transform however is necessary.

If no, I will just edit the metadata afterwards as advised.

- Sacha

On Wed, Dec 20, 2017 at 12:46 AM, Alessio Fabiani <[hidden email]> wrote:
You can try to use the following module

This management command should walk through a spatialdata set of files (either raster and vector) and import them on GeoNode and GeoServer with a default initial configuration.

You still have to edit the metadata manually on a later step.


Regards,

Alessio Fabiani

==
GeoServer Professional Services from the experts! Visit http://goo.gl/it488V for more information.
==

Ing. Alessio Fabiani

@alfa7691
Founder/Technical Lead


GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
Italy
phone: <a href="tel:+39%200584%20962313" value="+390584962313" target="_blank">+39 0584 962313
fax:     <a href="tel:+39%200584%20166%200272" value="+3905841660272" target="_blank">+39 0584 1660272
mob:   <a href="tel:+39%20331%20623%203686" value="+393316233686" target="_blank">+39 331 6233686

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

-------------------------------------------------------

AVVERTENZE AI SENSI DEL D.Lgs. 196/2003

Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003.

The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility  for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc.


On Tue, Dec 19, 2017 at 11:32 PM, Sacha Black <[hidden email]> wrote:

hi list,

I am new to GeoNode and interested in migrating a large number of layers (> 3000)  from an old Mapserver 6.x WMS server. They are mostly shapefiles and some rasters.

I know I can connect to the existing WMS service to use the layers in GeoNode, but since eventually the old server will be turned off, I would like to know the best option to import the layers into GeoNode permanently.

I set up a basic GeoNode in a clean Ubuntu 16.04 install using the Quick Guide (http://geonode.org/#install). But I didn't find any specific instructions for setting up a bulk import.

Is there any examples of using a script to do this kind of task? Is this a reasonable expectation? What warnings/best practices should I be aware of?

- Sacha





_______________________________________________
geonode-users mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/geonode-users





_______________________________________________
geonode-users mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/geonode-users