Confirm versions of ElasticSearch and Kibana?

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

Confirm versions of ElasticSearch and Kibana?

Jo Cook
Hi All,

In Geonetwork 3.8, are the instructions and versions for ElasticSearch
and Kibana the same as for previous versions?

Example pages:
https://github.com/geonetwork/core-geonetwork/tree/master/es
https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch

I believe from the changelog at
https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
that it should be ElastcSearch 7.2.1- is that correct, and is it the
same version of Kibana?

Happy to do the work updating the documentation once confirmed.

Thanks

Jo


--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
-- 
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates> for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK 
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
<https://twitter.com/astuntech>



iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/>
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training>

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login>




Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.


_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Confirm versions of ElasticSearch and Kibana?

Francois Prunayre
Hi Jo, ES and KB setup is the same as before and 3.8.0 require ES 7+ (mainly due to removal of the document type in ES7) and is built with 7.3.0 (same for master and ES branch).
7.3.1 is the latest and works fine too.

Cheers.

Francois

Le jeu. 12 sept. 2019 à 13:44, Jo Cook <[hidden email]> a écrit :
Hi All,

In Geonetwork 3.8, are the instructions and versions for ElasticSearch
and Kibana the same as for previous versions?

Example pages:
https://github.com/geonetwork/core-geonetwork/tree/master/es
https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch

I believe from the changelog at
https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
that it should be ElastcSearch 7.2.1- is that correct, and is it the
same version of Kibana?

Happy to do the work updating the documentation once confirmed.

Thanks

Jo


--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
-- 
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates> for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK 
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
<https://twitter.com/astuntech>



iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/>
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training>

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login>




Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.


_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork


_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Confirm versions of ElasticSearch and Kibana?

Jo Cook
Hi Francois,

Thanks- can you confirm the elasticdump steps on this page
https://github.com/geonetwork/core-geonetwork/tree/3.8.x/es/es-dashboards
the index-dashboard.json and index-mapping.json files are no longer
available (they are in the 3,6,x branch though).

I'm testing the debian packages for elasticsearch and kibana 7.3.2 as
it's much easier to download them and set them up as services, however
it's not quite working yet and I'm not sure if it's a version problem.
Currently I have elasticsearch working on localhost:9200 and kibana
working on localhost:5601 but from localhost:8080/geonetwork/dashboard
I get the following error:
resource_not_foundNo portal found with id 'dashboard'. The list of
available portals are: [srv]ResourceNotFoundException
and when I view the content statistics page in geonetwork the embedded
page is the tomcat index page!

What I've done so far is load features.json,records.json and
searchlogs.json and configured kibana.yml using the instructions at
the above link, that's it.

Any ideas?

Thanks again

Jo

On Thu, Sep 12, 2019 at 1:05 PM Francois Prunayre <[hidden email]> wrote:

>
> Hi Jo, ES and KB setup is the same as before and 3.8.0 require ES 7+ (mainly due to removal of the document type in ES7) and is built with 7.3.0 (same for master and ES branch).
> https://github.com/geonetwork/core-geonetwork/blob/3.8.x/pom.xml#L1360
> 7.3.1 is the latest and works fine too.
>
> Cheers.
>
> Francois
>
> Le jeu. 12 sept. 2019 à 13:44, Jo Cook <[hidden email]> a écrit :
>>
>> Hi All,
>>
>> In Geonetwork 3.8, are the instructions and versions for ElasticSearch
>> and Kibana the same as for previous versions?
>>
>> Example pages:
>> https://github.com/geonetwork/core-geonetwork/tree/master/es
>> https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
>> https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch
>>
>> I believe from the changelog at
>> https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
>> that it should be ElastcSearch 7.2.1- is that correct, and is it the
>> same version of Kibana?
>>
>> Happy to do the work updating the documentation once confirmed.
>>
>> Thanks
>>
>> Jo
>>
>>
>> --
>> Jo Cook
>> t:+44 7930 524 155/twitter:@archaeogeek
>> Please note that currently I do not work on Friday afternoons. For
>> urgent responses at that time, please visit
>> support.astuntechnology.com or phone our office on 01372 744009
>>
>> --
>> --
>> *Sign up to our mailing list
>> <https://astuntechnology.com/company/#email-updates> for updates on news,
>> products, conferences, events and training*
>> *
>> *
>>
>> Astun Technology Ltd, The
>> Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
>> t:+44 1372 744
>> 009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
>> <https://twitter.com/astuntech>
>>
>>
>>
>> iShare - enterprise geographic
>> intelligence platform <https://astuntechnology.com/ishare/>
>> GeoServer,
>> PostGIS and QGIS training <https://astuntechnology.com/services/#training>
>>
>> Helpdesk and customer portal
>> <http://support.astuntechnology.com/support/login>
>>
>>
>>
>>
>> Company registration
>> no. 5410695. Registered in England and Wales. Registered office: 120 Manor
>> Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.
>>
>>
>> _______________________________________________
>> GeoNetwork-devel mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
>> GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork



--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
-- 
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates> for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK 
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
<https://twitter.com/astuntech>



iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/>
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training>

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login>




Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.


_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Confirm versions of ElasticSearch and Kibana?

Francois Prunayre
Jo,

Le jeu. 12 sept. 2019 à 18:27, Jo Cook <[hidden email]> a écrit :
Hi Francois,

Thanks- can you confirm the elasticdump steps on this page
https://github.com/geonetwork/core-geonetwork/tree/3.8.x/es/es-dashboards
the index-dashboard.json and index-mapping.json files are no longer
available (they are in the 3,6,x branch though).


Indeed for the dashboard, in 7.x user can go to Kibana > Saved Object and restore
directly which loads index pattern + search + visualization + dashboard.

So we can remove instructions about elasticdump which is more complicated to use.

 
I'm testing the debian packages for elasticsearch and kibana 7.3.2 as
it's much easier to download them and set them up as services, however
it's not quite working yet and I'm not sure if it's a version problem.
Currently I have elasticsearch working on localhost:9200 and kibana
working on localhost:5601 but from localhost:8080/geonetwork/dashboard
I get the following error:
resource_not_foundNo portal found with id 'dashboard'. The list of
available portals are: [srv]ResourceNotFoundException
and when I view the content statistics page in geonetwork the embedded
page is the tomcat index page!
What I've done so far is load features.json,records.json and
searchlogs.json and configured kibana.yml using the instructions at
the above link, that's it.

Any ideas?

and the url should be http://localhost:8080/geonetwork/dashboards with a 's' ?

Francois

 

Thanks again

Jo

On Thu, Sep 12, 2019 at 1:05 PM Francois Prunayre <[hidden email]> wrote:
>
> Hi Jo, ES and KB setup is the same as before and 3.8.0 require ES 7+ (mainly due to removal of the document type in ES7) and is built with 7.3.0 (same for master and ES branch).
> https://github.com/geonetwork/core-geonetwork/blob/3.8.x/pom.xml#L1360
> 7.3.1 is the latest and works fine too.
>
> Cheers.
>
> Francois
>
> Le jeu. 12 sept. 2019 à 13:44, Jo Cook <[hidden email]> a écrit :
>>
>> Hi All,
>>
>> In Geonetwork 3.8, are the instructions and versions for ElasticSearch
>> and Kibana the same as for previous versions?
>>
>> Example pages:
>> https://github.com/geonetwork/core-geonetwork/tree/master/es
>> https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
>> https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch
>>
>> I believe from the changelog at
>> https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
>> that it should be ElastcSearch 7.2.1- is that correct, and is it the
>> same version of Kibana?
>>
>> Happy to do the work updating the documentation once confirmed.
>>
>> Thanks
>>
>> Jo
>>
>>
>> --
>> Jo Cook
>> t:+44 7930 524 155/twitter:@archaeogeek
>> Please note that currently I do not work on Friday afternoons. For
>> urgent responses at that time, please visit
>> support.astuntechnology.com or phone our office on 01372 744009
>>
>> --
>> --
>> *Sign up to our mailing list
>> <https://astuntechnology.com/company/#email-updates> for updates on news,
>> products, conferences, events and training*
>> *
>> *
>>
>> Astun Technology Ltd, The
>> Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
>> t:+44 1372 744
>> 009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
>> <https://twitter.com/astuntech>
>>
>>
>>
>> iShare - enterprise geographic
>> intelligence platform <https://astuntechnology.com/ishare/>
>> GeoServer,
>> PostGIS and QGIS training <https://astuntechnology.com/services/#training>
>>
>> Helpdesk and customer portal
>> <http://support.astuntechnology.com/support/login>
>>
>>
>>
>>
>> Company registration
>> no. 5410695. Registered in England and Wales. Registered office: 120 Manor
>> Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.
>>
>>
>> _______________________________________________
>> GeoNetwork-devel mailing list
>> [hidden email]
>> https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
>> GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork



--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
-- 
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates> for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK 
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
<https://twitter.com/astuntech>



iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/>
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training>

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login>




Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.


_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
Reply | Threaded
Open this post in threaded view
|

Re: Confirm versions of ElasticSearch and Kibana?

Jo Cook
Hi Francois,

Yes, that works (using export.json from the kibana dashboard and
correcting typos). The final part of the puzzle was commenting out the
section in web-inf/web.xml:
<filter-mapping>
      <filter-name>XFrameOptionsFilter</filter-name>
      <url-pattern>/*</url-pattern>
    </filter-mapping>

I'll create some new documentation on this, as I can confirm that the
standard packages work from the debian/ubuntu repositories and they
can easily be set up as services.

Thanks again

Jo

On Thu, Sep 12, 2019 at 5:38 PM Francois Prunayre <[hidden email]> wrote:

>
> Jo,
>
> Le jeu. 12 sept. 2019 à 18:27, Jo Cook <[hidden email]> a écrit :
>>
>> Hi Francois,
>>
>> Thanks- can you confirm the elasticdump steps on this page
>> https://github.com/geonetwork/core-geonetwork/tree/3.8.x/es/es-dashboards
>> the index-dashboard.json and index-mapping.json files are no longer
>> available (they are in the 3,6,x branch though).
>>
>
> Indeed for the dashboard, in 7.x user can go to Kibana > Saved Object and restore
> https://github.com/geonetwork/core-geonetwork/blob/3.8.x/es/es-dashboards/data/export.json
> directly which loads index pattern + search + visualization + dashboard.
>
> So we can remove instructions about elasticdump which is more complicated to use.
>
>
>>
>> I'm testing the debian packages for elasticsearch and kibana 7.3.2 as
>> it's much easier to download them and set them up as services, however
>> it's not quite working yet and I'm not sure if it's a version problem.
>> Currently I have elasticsearch working on localhost:9200 and kibana
>> working on localhost:5601 but from localhost:8080/geonetwork/dashboard
>> I get the following error:
>> resource_not_foundNo portal found with id 'dashboard'. The list of
>> available portals are: [srv]ResourceNotFoundException
>> and when I view the content statistics page in geonetwork the embedded
>> page is the tomcat index page!
>>
>> What I've done so far is load features.json,records.json and
>> searchlogs.json and configured kibana.yml using the instructions at
>> the above link, that's it.
>>
>> Any ideas?
>
>
> The KB proxy is created by https://github.com/geonetwork/core-geonetwork/blob/master/web/src/main/webResources/WEB-INF/web.xml#L444-L459
> and the url should be http://localhost:8080/geonetwork/dashboards with a 's' ?
>
> Francois
>
>
>>
>>
>> Thanks again
>>
>> Jo
>>
>> On Thu, Sep 12, 2019 at 1:05 PM Francois Prunayre <[hidden email]> wrote:
>> >
>> > Hi Jo, ES and KB setup is the same as before and 3.8.0 require ES 7+ (mainly due to removal of the document type in ES7) and is built with 7.3.0 (same for master and ES branch).
>> > https://github.com/geonetwork/core-geonetwork/blob/3.8.x/pom.xml#L1360
>> > 7.3.1 is the latest and works fine too.
>> >
>> > Cheers.
>> >
>> > Francois
>> >
>> > Le jeu. 12 sept. 2019 à 13:44, Jo Cook <[hidden email]> a écrit :
>> >>
>> >> Hi All,
>> >>
>> >> In Geonetwork 3.8, are the instructions and versions for ElasticSearch
>> >> and Kibana the same as for previous versions?
>> >>
>> >> Example pages:
>> >> https://github.com/geonetwork/core-geonetwork/tree/master/es
>> >> https://github.com/geonetwork/core-geonetwork/tree/master/es/es-dashboards
>> >> https://geonetwork-opensource.org/manuals/3.8.x/en/maintainer-guide/statistics/setup-elasticsearch.html?highlight=elasticsearch
>> >>
>> >> I believe from the changelog at
>> >> https://geonetwork-opensource.org/manuals/3.8.x/en/overview/change-log/version-3.8.0.html
>> >> that it should be ElastcSearch 7.2.1- is that correct, and is it the
>> >> same version of Kibana?
>> >>
>> >> Happy to do the work updating the documentation once confirmed.
>> >>
>> >> Thanks
>> >>
>> >> Jo
>> >>
>> >>
>> >> --
>> >> Jo Cook
>> >> t:+44 7930 524 155/twitter:@archaeogeek
>> >> Please note that currently I do not work on Friday afternoons. For
>> >> urgent responses at that time, please visit
>> >> support.astuntechnology.com or phone our office on 01372 744009
>> >>
>> >> --
>> >> --
>> >> *Sign up to our mailing list
>> >> <https://astuntechnology.com/company/#email-updates> for updates on news,
>> >> products, conferences, events and training*
>> >> *
>> >> *
>> >>
>> >> Astun Technology Ltd, The
>> >> Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
>> >> t:+44 1372 744
>> >> 009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
>> >> <https://twitter.com/astuntech>
>> >>
>> >>
>> >>
>> >> iShare - enterprise geographic
>> >> intelligence platform <https://astuntechnology.com/ishare/>
>> >> GeoServer,
>> >> PostGIS and QGIS training <https://astuntechnology.com/services/#training>
>> >>
>> >> Helpdesk and customer portal
>> >> <http://support.astuntechnology.com/support/login>
>> >>
>> >>
>> >>
>> >>
>> >> Company registration
>> >> no. 5410695. Registered in England and Wales. Registered office: 120 Manor
>> >> Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.
>> >>
>> >>
>> >> _______________________________________________
>> >> GeoNetwork-devel mailing list
>> >> [hidden email]
>> >> https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
>> >> GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork
>>
>>
>>
>> --
>> Jo Cook
>> t:+44 7930 524 155/twitter:@archaeogeek
>> Please note that currently I do not work on Friday afternoons. For
>> urgent responses at that time, please visit
>> support.astuntechnology.com or phone our office on 01372 744009
>>
>> --
>> --
>> *Sign up to our mailing list
>> <https://astuntechnology.com/company/#email-updates> for updates on news,
>> products, conferences, events and training*
>> *
>> *
>>
>> Astun Technology Ltd, The
>> Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK
>> t:+44 1372 744
>> 009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
>> <https://twitter.com/astuntech>
>>
>>
>>
>> iShare - enterprise geographic
>> intelligence platform <https://astuntechnology.com/ishare/>
>> GeoServer,
>> PostGIS and QGIS training <https://astuntechnology.com/services/#training>
>>
>> Helpdesk and customer portal
>> <http://support.astuntechnology.com/support/login>
>>
>>
>>
>>
>> Company registration
>> no. 5410695. Registered in England and Wales. Registered office: 120 Manor
>> Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.



--
Jo Cook
t:+44 7930 524 155/twitter:@archaeogeek
Please note that currently I do not work on Friday afternoons. For
urgent responses at that time, please visit
support.astuntechnology.com or phone our office on 01372 744009

--
-- 
*Sign up to our mailing list
<https://astuntechnology.com/company/#email-updates> for updates on news,
products, conferences, events and training*
*
*

Astun Technology Ltd, The
Coach House, 17 West Street, Epsom, Surrey, KT18 7RL, UK 
t:+44 1372 744
009 w: astuntechnology.com <http://astuntechnology.com/> twitter:@astuntech
<https://twitter.com/astuntech>



iShare - enterprise geographic
intelligence platform <https://astuntechnology.com/ishare/>
GeoServer,
PostGIS and QGIS training <https://astuntechnology.com/services/#training>

Helpdesk and customer portal
<http://support.astuntechnology.com/support/login>




Company registration
no. 5410695. Registered in England and Wales. Registered office: 120 Manor
Green Road, Epsom, Surrey, KT19 8LN VAT no. 864201149.


_______________________________________________
GeoNetwork-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/geonetwork-devel
GeoNetwork OpenSource is maintained at http://sourceforge.net/projects/geonetwork