[QGIS-Developer] QGIS 3.8.0 on FreeBSD: build takes several hours

Next Topic
 
classic Classic list List threaded Threaded
16 messages Options
Reply | Threaded
Open this post in threaded view
|

[QGIS-Developer] QGIS 3.8.0 on FreeBSD: build takes several hours

Rainer Hurling
As the maintainer of the QGIS port for FreeBSD, I am preparing a port
for the recent update to QGIS 3.8.0.

The build process takes a very long pause of several hours(!) at about
21% of the code, before it proceeds:

[..snip..]
[ 21%] Building CXX object
src/core/CMakeFiles/qgis_core.dir/gps/moc_qgsqtlocationconnection.cpp.o
cd /usr/ports/graphics/qgis/work/.build/src/core && /usr/bin/c++
-DPROJ_VERSION_MAJOR=6 -DQT_CONCURRENT_LIB -DQT_CORE_LIB
-DQT_DISABLE_DEPRECATED_BEFORE=0 -DQT_GUI_LIB -DQT_NETWORK_LIB
-DQT_NO_CAST_TO_ASCII -DQT_NO_DEBUG -DQT_NO_FOREACH -DQT_POSITIONING_LIB
-DQT_PRINTSUPPORT_LIB -DQT_SERIALPORT_LIB -DQT_SQL_LIB -DQT_SVG_LIB
-DQT_WEBKITWIDGETS_LIB -DQT_WEBKIT_LIB -DQT_WIDGETS_LIB -DQT_XML_LIB
-DSIP_VERSION=0x041311
-DTEST_DATA_DIR=\"/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/tests/testdata\"
-DWITH_BINDINGS -DWITH_QTWEBKIT -D_HAVE_PTHREAD_ -Dqgis_core_EXPORTS
-I/usr/ports/graphics/qgis/work/.build
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core
-I/usr/ports/graphics/qgis/work/.build/src/core
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/3d
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/annotations
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/auth
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/dxf
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/effects
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/expression
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/fieldformatter
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/geometry
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/geocms
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/geocms/geonode
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/layertree
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/layout
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/locator
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/metadata
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/pal
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/processing
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/processing/models
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/providers
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/providers/memory
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/raster
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/renderer
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/scalebar
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/symbology
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/mesh
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/src/core/validity
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/external
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/external/kdbush/include
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/external/nmea
-I/usr/ports/graphics/qgis/work/QGIS-final-3_8_0/external/poly2tri
-isystem /usr/local/include -isystem /usr/local/include/Qca-qt5/QtCrypto
-isystem /usr/local/include/qt5keychain -isystem /usr/local/include/qt5
-isystem /usr/local/include/qt5/QtSerialPort -isystem
/usr/local/include/qt5/QtCore -isystem
/usr/local/lib/qt5/mkspecs/freebsd-clang -isystem
/usr/local/include/qt5/QtXml -isystem /usr/local/include/qt5/QtGui
-isystem /usr/local/include/qt5/QtWidgets -isystem
/usr/local/include/qt5/QtSvg -isystem
/usr/local/include/qt5/QtPrintSupport -isystem
/usr/local/include/qt5/QtNetwork -isystem
/usr/local/include/qt5/QtWebKitWidgets -isystem
/usr/local/include/qt5/QtWebKit -isystem /usr/local/include/qt5/QtSql
-isystem /usr/local/include/qt5/QtConcurrent -isystem
/usr/local/include/qt5/QtPositioning  -O2 -pipe -fstack-protector-strong
-fno-strict-aliasing -Wall -Wextra -Wno-long-long -Wformat-security
-Wno-strict-aliasing -Wno-return-type-c-linkage -Wno-overloaded-virtual
-Wimplicit-fallthrough -Qunused-arguments -O2 -pipe
-fstack-protector-strong -fno-strict-aliasing -fPIC -fvisibility=hidden
 -fPIC -std=gnu++11 -Wno-deprecated-declarations -o
CMakeFiles/qgis_core.dir/gps/moc_qgsqtlocationconnection.cpp.o -c
/usr/ports/graphics/qgis/work/.build/src/core/gps/moc_qgsqtlocationconnection.cpp


This seems to happen since #18fb3f2 [1] (committed 2019-05-13, submitted
2019-04-30). Before the commit, the build process takes a normal
duration on FreeBSD.

As far as I can say, the problem occurs with both proj-5.1.0 and
proj-6.1.0. GDAL version is 2.4.1, the OS is FreeBSD 13-0 CURRENT amd64.

Does anyone else observes something like this? I suspect, that the long
pause has do with a conversion problem into the proj db. What do you think?

Thanks for any help. And please let me know, if I should provide more
information or test something.

Best wishes,
Rainer Hurling

[1]
https://github.com/qgis/QGIS/commit/18fb3f2bad83f208aa32d32600047e2faff24d14
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Nyall Dawson
On Sat, 22 Jun 2019 at 16:55, Rainer Hurling <[hidden email]> wrote:

>
> As the maintainer of the QGIS port for FreeBSD, I am preparing a port
> for the recent update to QGIS 3.8.0.
>
>
> This seems to happen since #18fb3f2 [1] (committed 2019-05-13, submitted
> 2019-04-30). Before the commit, the build process takes a normal
> duration on FreeBSD.
>
> As far as I can say, the problem occurs with both proj-5.1.0 and
> proj-6.1.0. GDAL version is 2.4.1, the OS is FreeBSD 13-0 CURRENT amd64.
>

Hmm - perplexing. Most of that commit should be ifdefed out for proj <
6 builds. I wonder if you tried trimming the contents of
qgscoordinatereferencesystem_legacy.h to just a couple of sample lines
as a test? Maybe there's something in the compiler which doesn't like
the large static QMap...

Nyall
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Rainer Hurling
Hi Nyall,

Am 24.06.19 um 01:33 schrieb Nyall Dawson:

> On Sat, 22 Jun 2019 at 16:55, Rainer Hurling <[hidden email]> wrote:
>>
>> As the maintainer of the QGIS port for FreeBSD, I am preparing a port
>> for the recent update to QGIS 3.8.0.
>>
>>
>> This seems to happen since #18fb3f2 [1] (committed 2019-05-13, submitted
>> 2019-04-30). Before the commit, the build process takes a normal
>> duration on FreeBSD.
>>
>> As far as I can say, the problem occurs with both proj-5.1.0 and
>> proj-6.1.0. GDAL version is 2.4.1, the OS is FreeBSD 13-0 CURRENT amd64.
>>
>
> Hmm - perplexing. Most of that commit should be ifdefed out for proj <
> 6 builds. I wonder if you tried trimming the contents of
> qgscoordinatereferencesystem_legacy.h to just a couple of sample lines
> as a test? Maybe there's something in the compiler which doesn't like
> the large static QMap...
>
> Nyall
>

Many thanks for your response.

After trimming the contents of qgscoordinatereferencesystem_legacy.h
(about 10 lines left), it builds in a normal time again.

So it is likely, that the problem on FreeBSD has something to do with
its compiler suite? I am using FreeBSD clang version 8.0.1
(branches/release_80 363030) (based on LLVM 8.0.1).

Is there any workaround, which lets me use the whole contents again?

Rainer
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Nyall Dawson
On Mon, 24 Jun 2019 at 20:48, Rainer Hurling <[hidden email]> wrote:

>
> Hi Nyall,
>
> Am 24.06.19 um 01:33 schrieb Nyall Dawson:
> > On Sat, 22 Jun 2019 at 16:55, Rainer Hurling <[hidden email]> wrote:
> >>
> >> As the maintainer of the QGIS port for FreeBSD, I am preparing a port
> >> for the recent update to QGIS 3.8.0.
> >>
> >>
> >> This seems to happen since #18fb3f2 [1] (committed 2019-05-13, submitted
> >> 2019-04-30). Before the commit, the build process takes a normal
> >> duration on FreeBSD.
> >>
> >> As far as I can say, the problem occurs with both proj-5.1.0 and
> >> proj-6.1.0. GDAL version is 2.4.1, the OS is FreeBSD 13-0 CURRENT amd64.
> >>
> >
> > Hmm - perplexing. Most of that commit should be ifdefed out for proj <
> > 6 builds. I wonder if you tried trimming the contents of
> > qgscoordinatereferencesystem_legacy.h to just a couple of sample lines
> > as a test? Maybe there's something in the compiler which doesn't like
> > the large static QMap...
> >
> > Nyall
> >
>
> Many thanks for your response.
>
> After trimming the contents of qgscoordinatereferencesystem_legacy.h
> (about 10 lines left), it builds in a normal time again.
>
> So it is likely, that the problem on FreeBSD has something to do with
> its compiler suite? I am using FreeBSD clang version 8.0.1
> (branches/release_80 363030) (based on LLVM 8.0.1).
>
> Is there any workaround, which lets me use the whole contents again?

You could try swapping the QMap for a std::unordered_map and see if
there's any benefit.

Nyall
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Rainer Hurling
Am 24.06.19 um 13:02 schrieb Nyall Dawson:

> On Mon, 24 Jun 2019 at 20:48, Rainer Hurling <[hidden email]> wrote:
>>
>> Hi Nyall,
>>
>> Am 24.06.19 um 01:33 schrieb Nyall Dawson:
>>> On Sat, 22 Jun 2019 at 16:55, Rainer Hurling <[hidden email]> wrote:
>>>>
>>>> As the maintainer of the QGIS port for FreeBSD, I am preparing a port
>>>> for the recent update to QGIS 3.8.0.
>>>>
>>>>
>>>> This seems to happen since #18fb3f2 [1] (committed 2019-05-13, submitted
>>>> 2019-04-30). Before the commit, the build process takes a normal
>>>> duration on FreeBSD.
>>>>
>>>> As far as I can say, the problem occurs with both proj-5.1.0 and
>>>> proj-6.1.0. GDAL version is 2.4.1, the OS is FreeBSD 13-0 CURRENT amd64.
>>>>
>>>
>>> Hmm - perplexing. Most of that commit should be ifdefed out for proj <
>>> 6 builds. I wonder if you tried trimming the contents of
>>> qgscoordinatereferencesystem_legacy.h to just a couple of sample lines
>>> as a test? Maybe there's something in the compiler which doesn't like
>>> the large static QMap...
>>>
>>> Nyall
>>>
>>
>> Many thanks for your response.
>>
>> After trimming the contents of qgscoordinatereferencesystem_legacy.h
>> (about 10 lines left), it builds in a normal time again.
>>
>> So it is likely, that the problem on FreeBSD has something to do with
>> its compiler suite? I am using FreeBSD clang version 8.0.1
>> (branches/release_80 363030) (based on LLVM 8.0.1).
>>
>> Is there any workaround, which lets me use the whole contents again?
>
> You could try swapping the QMap for a std::unordered_map and see if
> there's any benefit.
>
> Nyall
>

I am afraid I have no clue how to do this, because I am not a c++ coder.

Is it within qgscoordinatereferencesystem_legacy.h
(sAuthIdToQgisSrsIdMap?) or better in qgscoordinatereferencesystem.cpp
(at lines:386-405?).

As I said in my initial posting, the build duration problem exists on
both, proj 5.1.0 and 6.1.0 on FreeBSD ...

Rainer
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

lbartoletti
Hi,

Personally on my build machine [1] I've never had a problem to build
QGIS master.

Rainer, some questions:

  - did you compile from scratch or via our infrastructure
(ports/poudriere/synth?)?

- did you have the same problem with FreeBSD 11 or 12?

- can you try with llvm 6 or 7 from ports (I think that FreeBSD 13 have
llvm 8 by default)?

Regards,

Loïc

[1] A jail with clang 6, qt 5.12, gdal 2.4.1, proj 5.1.0

Le 24/06/2019 à 13:33, Rainer Hurling a écrit :

> Am 24.06.19 um 13:02 schrieb Nyall Dawson:
>> On Mon, 24 Jun 2019 at 20:48, Rainer Hurling <[hidden email]> wrote:
>>> Hi Nyall,
>>>
>>> Am 24.06.19 um 01:33 schrieb Nyall Dawson:
>>>> On Sat, 22 Jun 2019 at 16:55, Rainer Hurling <[hidden email]> wrote:
>>>>> As the maintainer of the QGIS port for FreeBSD, I am preparing a port
>>>>> for the recent update to QGIS 3.8.0.
>>>>>
>>>>>
>>>>> This seems to happen since #18fb3f2 [1] (committed 2019-05-13, submitted
>>>>> 2019-04-30). Before the commit, the build process takes a normal
>>>>> duration on FreeBSD.
>>>>>
>>>>> As far as I can say, the problem occurs with both proj-5.1.0 and
>>>>> proj-6.1.0. GDAL version is 2.4.1, the OS is FreeBSD 13-0 CURRENT amd64.
>>>>>
>>>> Hmm - perplexing. Most of that commit should be ifdefed out for proj <
>>>> 6 builds. I wonder if you tried trimming the contents of
>>>> qgscoordinatereferencesystem_legacy.h to just a couple of sample lines
>>>> as a test? Maybe there's something in the compiler which doesn't like
>>>> the large static QMap...
>>>>
>>>> Nyall
>>>>
>>> Many thanks for your response.
>>>
>>> After trimming the contents of qgscoordinatereferencesystem_legacy.h
>>> (about 10 lines left), it builds in a normal time again.
>>>
>>> So it is likely, that the problem on FreeBSD has something to do with
>>> its compiler suite? I am using FreeBSD clang version 8.0.1
>>> (branches/release_80 363030) (based on LLVM 8.0.1).
>>>
>>> Is there any workaround, which lets me use the whole contents again?
>> You could try swapping the QMap for a std::unordered_map and see if
>> there's any benefit.
>>
>> Nyall
>>
> I am afraid I have no clue how to do this, because I am not a c++ coder.
>
> Is it within qgscoordinatereferencesystem_legacy.h
> (sAuthIdToQgisSrsIdMap?) or better in qgscoordinatereferencesystem.cpp
> (at lines:386-405?).
>
> As I said in my initial posting, the build duration problem exists on
> both, proj 5.1.0 and 6.1.0 on FreeBSD ...
>
> Rainer
> _______________________________________________
> QGIS-Developer mailing list
> [hidden email]
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Rainer Hurling
Hi Loïc,

Am 25.06.19 um 22:52 schrieb Loïc Bartoletti:
> Hi,
>
> Personally on my build machine [1] I've never had a problem to build
> QGIS master.
>
> Rainer, some questions:
>
>   - did you compile from scratch or via our infrastructure
> (ports/poudriere/synth?)?

I build from the ports system, with an updated graphics/qgis port,
prepared for the change from QGIS 3.6.0 to 3.8.0.

The behaviour is the same on my real life boxes and on Poudriere.

>
> - did you have the same problem with FreeBSD 11 or 12?

Until now, I only tested with FreeBSD 13.0-CURRENT. Will try on
Poudriere with FreeBSD 11 or 12 in the next days.

>
> - can you try with llvm 6 or 7 from ports (I think that FreeBSD 13 have
> llvm 8 by default)?

Loïc, this seems to be the right approach. With llvm 8 and 7 the build
fails, with llvm 6 all builts fine!

As a fallback (workaround), I could enforce the port to use llvm 6,
until the real cause is found.

The problem seems to be with
src/core/qgscoordinatereferencesystem_legacy.h and its long table,
handled via QMap. Obviously, newer llvm versions (7 and 8) are not able
to create the code correctly.

Thanks for your answer and hints,
Rainer

>
> Regards,
>
> Loïc
>
> [1] A jail with clang 6, qt 5.12, gdal 2.4.1, proj 5.1.0
>
> Le 24/06/2019 à 13:33, Rainer Hurling a écrit :
>> Am 24.06.19 um 13:02 schrieb Nyall Dawson:
>>> On Mon, 24 Jun 2019 at 20:48, Rainer Hurling <[hidden email]> wrote:
>>>> Hi Nyall,
>>>>
>>>> Am 24.06.19 um 01:33 schrieb Nyall Dawson:
>>>>> On Sat, 22 Jun 2019 at 16:55, Rainer Hurling <[hidden email]> wrote:
>>>>>> As the maintainer of the QGIS port for FreeBSD, I am preparing a port
>>>>>> for the recent update to QGIS 3.8.0.
>>>>>>
>>>>>>
>>>>>> This seems to happen since #18fb3f2 [1] (committed 2019-05-13,
>>>>>> submitted
>>>>>> 2019-04-30). Before the commit, the build process takes a normal
>>>>>> duration on FreeBSD.
>>>>>>
>>>>>> As far as I can say, the problem occurs with both proj-5.1.0 and
>>>>>> proj-6.1.0. GDAL version is 2.4.1, the OS is FreeBSD 13-0 CURRENT
>>>>>> amd64.
>>>>>>
>>>>> Hmm - perplexing. Most of that commit should be ifdefed out for proj <
>>>>> 6 builds. I wonder if you tried trimming the contents of
>>>>> qgscoordinatereferencesystem_legacy.h to just a couple of sample lines
>>>>> as a test? Maybe there's something in the compiler which doesn't like
>>>>> the large static QMap...
>>>>>
>>>>> Nyall
>>>>>
>>>> Many thanks for your response.
>>>>
>>>> After trimming the contents of qgscoordinatereferencesystem_legacy.h
>>>> (about 10 lines left), it builds in a normal time again.
>>>>
>>>> So it is likely, that the problem on FreeBSD has something to do with
>>>> its compiler suite? I am using FreeBSD clang version 8.0.1
>>>> (branches/release_80 363030) (based on LLVM 8.0.1).
>>>>
>>>> Is there any workaround, which lets me use the whole contents again?
>>> You could try swapping the QMap for a std::unordered_map and see if
>>> there's any benefit.
>>>
>>> Nyall
>>>
>> I am afraid I have no clue how to do this, because I am not a c++ coder.
>>
>> Is it within qgscoordinatereferencesystem_legacy.h
>> (sAuthIdToQgisSrsIdMap?) or better in qgscoordinatereferencesystem.cpp
>> (at lines:386-405?).
>>
>> As I said in my initial posting, the build duration problem exists on
>> both, proj 5.1.0 and 6.1.0 on FreeBSD ...
>>
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

lbartoletti
Hi rainer,

Le 26/06/2019 à 11:23, Rainer Hurling a écrit :
>> - can you try with llvm 6 or 7 from ports (I think that FreeBSD 13
>> have llvm 8 by default)?
>
> Loïc, this seems to be the right approach. With llvm 8 and 7 the build
> fails, with llvm 6 all builts fine!
>
> As a fallback (workaround), I could enforce the port to use llvm 6,
> until the real cause is found.
You should fill an issue to our bugzilla. Maybe llvm or core dev can
take a look at this bug? AFAIK, Ed found already an error (not
reproduced?) in FreeBSD devel with newest llvm version.
>
> The problem seems to be with
> src/core/qgscoordinatereferencesystem_legacy.h and its long table,
> handled via QMap. Obviously, newer llvm versions (7 and 8) are not
> able to create the code correctly.
>
I'll test with newer llvm version but on FreeBSD 12.

It doesn't seem to affect Linux, since Docker is based on Ubuntu 19.04
and clang 8 if I'm not mistaken. Nyall, Denis, can you confirm?

Regards

Loïc

_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Matthias Kuhn 🌍
FYI,

An upstream bug has been closed on Qt side

https://bugreports.qt.io/browse/QTBUG-57672

I didn't find a matching one on LLVM side so I opened one

https://bugs.llvm.org/show_bug.cgi?id=42515

Matthias

On 6/26/19 11:50 AM, Loïc Bartoletti wrote:

> Hi rainer,
>
> Le 26/06/2019 à 11:23, Rainer Hurling a écrit :
>>> - can you try with llvm 6 or 7 from ports (I think that FreeBSD 13
>>> have llvm 8 by default)?
>>
>> Loïc, this seems to be the right approach. With llvm 8 and 7 the
>> build fails, with llvm 6 all builts fine!
>>
>> As a fallback (workaround), I could enforce the port to use llvm 6,
>> until the real cause is found.
> You should fill an issue to our bugzilla. Maybe llvm or core dev can
> take a look at this bug? AFAIK, Ed found already an error (not
> reproduced?) in FreeBSD devel with newest llvm version.
>>
>> The problem seems to be with
>> src/core/qgscoordinatereferencesystem_legacy.h and its long table,
>> handled via QMap. Obviously, newer llvm versions (7 and 8) are not
>> able to create the code correctly.
>>
> I'll test with newer llvm version but on FreeBSD 12.
>
> It doesn't seem to affect Linux, since Docker is based on Ubuntu 19.04
> and clang 8 if I'm not mistaken. Nyall, Denis, can you confirm?
>
> Regards
>
> Loïc
>
> _______________________________________________
> QGIS-Developer mailing list
> [hidden email]
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
>
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Rainer Hurling
Hi Matthias,

Thanks for keeping this up.

It sounds like OSX hits the same problem with LLVM 8.0.0.

Rainer


Am 05.07.19 um 10:45 schrieb Matthias Kuhn:

> FYI,
>
> An upstream bug has been closed on Qt side
>
> https://bugreports.qt.io/browse/QTBUG-57672
>
> I didn't find a matching one on LLVM side so I opened one
>
> https://bugs.llvm.org/show_bug.cgi?id=42515
>
> Matthias
>
> On 6/26/19 11:50 AM, Loïc Bartoletti wrote:
>> Hi rainer,
>>
>> Le 26/06/2019 à 11:23, Rainer Hurling a écrit :
>>>> - can you try with llvm 6 or 7 from ports (I think that FreeBSD 13
>>>> have llvm 8 by default)?
>>>
>>> Loïc, this seems to be the right approach. With llvm 8 and 7 the
>>> build fails, with llvm 6 all builts fine!
>>>
>>> As a fallback (workaround), I could enforce the port to use llvm 6,
>>> until the real cause is found.
>> You should fill an issue to our bugzilla. Maybe llvm or core dev can
>> take a look at this bug? AFAIK, Ed found already an error (not
>> reproduced?) in FreeBSD devel with newest llvm version.
>>>
>>> The problem seems to be with
>>> src/core/qgscoordinatereferencesystem_legacy.h and its long table,
>>> handled via QMap. Obviously, newer llvm versions (7 and 8) are not
>>> able to create the code correctly.
>>>
>> I'll test with newer llvm version but on FreeBSD 12.
>>
>> It doesn't seem to affect Linux, since Docker is based on Ubuntu 19.04
>> and clang 8 if I'm not mistaken. Nyall, Denis, can you confirm?
>>
>> Regards
>>
>> Loïc

_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Matthias Kuhn 🌍
Hi Rainer,

There has been a question for a minimal example to reproduce the problem
on the bugreport.

I have come up with
https://github.com/m-kuhn/qmap_initializer_compile_time but don't easily
have an environment available to reproduce the problem. Are you able to
verify the issue with the code before, so it can confidently attached to
the issue?

Thanks
Matthias

On 7/6/19 8:52 AM, Rainer Hurling wrote:

> Hi Matthias,
>
> Thanks for keeping this up.
>
> It sounds like OSX hits the same problem with LLVM 8.0.0.
>
> Rainer
>
>
> Am 05.07.19 um 10:45 schrieb Matthias Kuhn:
>> FYI,
>>
>> An upstream bug has been closed on Qt side
>>
>> https://bugreports.qt.io/browse/QTBUG-57672
>>
>> I didn't find a matching one on LLVM side so I opened one
>>
>> https://bugs.llvm.org/show_bug.cgi?id=42515
>>
>> Matthias
>>
>> On 6/26/19 11:50 AM, Loïc Bartoletti wrote:
>>> Hi rainer,
>>>
>>> Le 26/06/2019 à 11:23, Rainer Hurling a écrit :
>>>>> - can you try with llvm 6 or 7 from ports (I think that FreeBSD 13
>>>>> have llvm 8 by default)?
>>>> Loïc, this seems to be the right approach. With llvm 8 and 7 the
>>>> build fails, with llvm 6 all builts fine!
>>>>
>>>> As a fallback (workaround), I could enforce the port to use llvm 6,
>>>> until the real cause is found.
>>> You should fill an issue to our bugzilla. Maybe llvm or core dev can
>>> take a look at this bug? AFAIK, Ed found already an error (not
>>> reproduced?) in FreeBSD devel with newest llvm version.
>>>> The problem seems to be with
>>>> src/core/qgscoordinatereferencesystem_legacy.h and its long table,
>>>> handled via QMap. Obviously, newer llvm versions (7 and 8) are not
>>>> able to create the code correctly.
>>>>
>>> I'll test with newer llvm version but on FreeBSD 12.
>>>
>>> It doesn't seem to affect Linux, since Docker is based on Ubuntu 19.04
>>> and clang 8 if I'm not mistaken. Nyall, Denis, can you confirm?
>>>
>>> Regards
>>>
>>> Loïc
> _______________________________________________
> QGIS-Developer mailing list
> [hidden email]
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
>
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

lbartoletti
Hi Matthias, Rainer,

Matthias, I tested but unfortunately I can't reproduce the problem with this
code. Tested with llvm 6, 7 and 8 on FreeBSD 12 and 13 amd64.

But, of course :), the problem is still present for QGIS with llvm 8.0.1 on
FreeBSD 13.

For information, I created a CI on Cirrus for FreeBSD 12 and here the
results: https://cirrus-ci.com/task/5576588232491008 and my fork of your
repository https://github.com/lbartoletti/qmap_initializer_compile_time

Thanks to take care about this issue.

Loïc





--
Sent from: http://osgeo-org.1560.x6.nabble.com/QGIS-Developer-f4099106.html
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Matthias Kuhn 🌍
Hi Loïc,

Thanks for the feedback.

Any idea what else could be tried?

Unfortunately I do not have a system where I could quickly try, so I am
out of possibilities and ideas for now ...

Best regards

Matthias

On 7/12/19 9:47 PM, lbartoletti wrote:

> Hi Matthias, Rainer,
>
> Matthias, I tested but unfortunately I can't reproduce the problem with this
> code. Tested with llvm 6, 7 and 8 on FreeBSD 12 and 13 amd64.
>
> But, of course :), the problem is still present for QGIS with llvm 8.0.1 on
> FreeBSD 13.
>
> For information, I created a CI on Cirrus for FreeBSD 12 and here the
> results: https://cirrus-ci.com/task/5576588232491008 and my fork of your
> repository https://github.com/lbartoletti/qmap_initializer_compile_time
>
> Thanks to take care about this issue.
>
> Loïc
>
>
>
>
>
> --
> Sent from: http://osgeo-org.1560.x6.nabble.com/QGIS-Developer-f4099106.html
> _______________________________________________
> QGIS-Developer mailing list
> [hidden email]
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
>
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Rainer Hurling
In reply to this post by Matthias Kuhn 🌍
Hi Matthias,

sorry for the late answer, but I was busy at work

My skill on C++ and CMAKE are very limited. The following steps should
show, what I did and hopefully understood right:

- create a local directory 'qmap_initializer_compile_time'
- download your files into the dir
- create a second dir 'qmap_initializer_compile_time_BUILD' one level up
- run 'cmake ../qmap_initializer_compile_time' in the latter
  (compilation takes only a moment)

  -- The CXX compiler identification is Clang 8.0.1
  -- Check for working CXX compiler: /usr/bin/c++
  -- Check for working CXX compiler: /usr/bin/c++ -- works
  -- Detecting CXX compiler ABI info
  -- Detecting CXX compiler ABI info - done
  -- Detecting CXX compile features
  -- Detecting CXX compile features - done
  -- Configuring done
  -- Generating done
  -- Build files have been written to: ~/qmap_initializer_compile_time_BUILD

- #list -l
  -rw-r--r--  1 rhurlin  user  -  12186  2019-07-12 20:45:35  CMakeCache.txt
  drwxr-xr-x  6 rhurlin  user  -    512  2019-07-12 20:45:44  CMakeFiles
  -rw-r--r--  1 rhurlin  user  -   7679  2019-07-12 20:45:35  Makefile
  -rw-r--r--  1 rhurlin  user  -   1409  2019-07-12 20:45:35
cmake_install.cmake
  -rwxr-xr-x  1 rhurlin  user  - 533248  2019-07-12 20:45:44
qmap_initializer_compile_time
  drwxr-xr-x  3 rhurlin  user  -    512  2019-07-12 20:45:38
qmap_initializer_compile_time_autogen

- Do I have to run ./qmap_initializer_compile_time after this (?)
- How long do I have to wait then ... (?)

I suspect, that my last steps are inappropriate to get the compile time
of QMap? I could use some help here ...

Rainer


Am 12.07.19 um 07:54 schrieb Matthias Kuhn:

> Hi Rainer,
>
> There has been a question for a minimal example to reproduce the problem
> on the bugreport.
>
> I have come up with
> https://github.com/m-kuhn/qmap_initializer_compile_time but don't easily
> have an environment available to reproduce the problem. Are you able to
> verify the issue with the code before, so it can confidently attached to
> the issue?
>
> Thanks
> Matthias
>
> On 7/6/19 8:52 AM, Rainer Hurling wrote:
>> Hi Matthias,
>>
>> Thanks for keeping this up.
>>
>> It sounds like OSX hits the same problem with LLVM 8.0.0.
>>
>> Rainer
>>
>>
>> Am 05.07.19 um 10:45 schrieb Matthias Kuhn:
>>> FYI,
>>>
>>> An upstream bug has been closed on Qt side
>>>
>>> https://bugreports.qt.io/browse/QTBUG-57672
>>>
>>> I didn't find a matching one on LLVM side so I opened one
>>>
>>> https://bugs.llvm.org/show_bug.cgi?id=42515
>>>
>>> Matthias
>>>
>>> On 6/26/19 11:50 AM, Loïc Bartoletti wrote:
>>>> Hi rainer,
>>>>
>>>> Le 26/06/2019 à 11:23, Rainer Hurling a écrit :
>>>>>> - can you try with llvm 6 or 7 from ports (I think that FreeBSD 13
>>>>>> have llvm 8 by default)?
>>>>> Loïc, this seems to be the right approach. With llvm 8 and 7 the
>>>>> build fails, with llvm 6 all builts fine!
>>>>>
>>>>> As a fallback (workaround), I could enforce the port to use llvm 6,
>>>>> until the real cause is found.
>>>> You should fill an issue to our bugzilla. Maybe llvm or core dev can
>>>> take a look at this bug? AFAIK, Ed found already an error (not
>>>> reproduced?) in FreeBSD devel with newest llvm version.
>>>>> The problem seems to be with
>>>>> src/core/qgscoordinatereferencesystem_legacy.h and its long table,
>>>>> handled via QMap. Obviously, newer llvm versions (7 and 8) are not
>>>>> able to create the code correctly.
>>>>>
>>>> I'll test with newer llvm version but on FreeBSD 12.
>>>>
>>>> It doesn't seem to affect Linux, since Docker is based on Ubuntu 19.04
>>>> and clang 8 if I'm not mistaken. Nyall, Denis, can you confirm?
>>>>
>>>> Regards
>>>>
>>>> Loïc
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

lbartoletti
In reply to this post by Matthias Kuhn 🌍
Hi Mathias, Hi Rainer,

Rainer, I update all ports and I cannot reproduce the issue... Tested on
FreeBSD 12 (jail) with clang 8.0.1 and clang 9.0rc1.

Do you still have this problem?

Best regards.

Loïc

Le 12/07/2019 à 22:44, Matthias Kuhn a écrit :

> Hi Loïc,
>
> Thanks for the feedback.
>
> Any idea what else could be tried?
>
> Unfortunately I do not have a system where I could quickly try, so I
> am out of possibilities and ideas for now ...
>
> Best regards
>
> Matthias
>
> On 7/12/19 9:47 PM, lbartoletti wrote:
>> Hi Matthias, Rainer,
>>
>> Matthias, I tested but unfortunately I can't reproduce the problem
>> with this
>> code. Tested with llvm 6, 7 and 8 on FreeBSD 12 and 13 amd64.
>>
>> But, of course :), the problem is still present for QGIS with llvm
>> 8.0.1 on
>> FreeBSD 13.
>>
>> For information, I created a CI on Cirrus for FreeBSD 12 and here the
>> results: https://cirrus-ci.com/task/5576588232491008 and my fork of your
>> repository https://github.com/lbartoletti/qmap_initializer_compile_time
>>
>> Thanks to take care about this issue.
>>
>> Loïc
>>
>>
>>
>>
>>
>> --
>> Sent from:
>> http://osgeo-org.1560.x6.nabble.com/QGIS-Developer-f4099106.html
>> _______________________________________________
>> QGIS-Developer mailing list
>> [hidden email]
>> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
>> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
>>
> _______________________________________________
> QGIS-Developer mailing list
> [hidden email]
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Reply | Threaded
Open this post in threaded view
|

Re: QGIS 3.8.0 on FreeBSD: build takes several hours

Rainer Hurling
Hi Loïc,

Sorry for the late answer, I had been on vacation for some days.

I tested again on a recent HEAD amd64 (r351113) and it fails with clang
8.0.1, but builds with clang 9.0rc2! So this really seems to be a
special problem of clang and should be solved until 9.0x.

In the next days, I will prepare the updates for graphics/qgis-ltr and
graphics/qgis.

Best wishes,
Rainer


On 10.08.19 10:14, Loïc Bartoletti wrote:

> Hi Mathias, Hi Rainer,
>
> Rainer, I update all ports and I cannot reproduce the issue... Tested on
> FreeBSD 12 (jail) with clang 8.0.1 and clang 9.0rc1.
>
> Do you still have this problem?
>
> Best regards.
>
> Loïc
>
> Le 12/07/2019 à 22:44, Matthias Kuhn a écrit :
>> Hi Loïc,
>>
>> Thanks for the feedback.
>>
>> Any idea what else could be tried?
>>
>> Unfortunately I do not have a system where I could quickly try, so I
>> am out of possibilities and ideas for now ...
>>
>> Best regards
>>
>> Matthias
>>
>> On 7/12/19 9:47 PM, lbartoletti wrote:
>>> Hi Matthias, Rainer,
>>>
>>> Matthias, I tested but unfortunately I can't reproduce the problem
>>> with this
>>> code. Tested with llvm 6, 7 and 8 on FreeBSD 12 and 13 amd64.
>>>
>>> But, of course :), the problem is still present for QGIS with llvm
>>> 8.0.1 on
>>> FreeBSD 13.
>>>
>>> For information, I created a CI on Cirrus for FreeBSD 12 and here the
>>> results: https://cirrus-ci.com/task/5576588232491008 and my fork of your
>>> repository https://github.com/lbartoletti/qmap_initializer_compile_time
>>>
>>> Thanks to take care about this issue.
>>>
>>> Loïc
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Sent from:
>>> http://osgeo-org.1560.x6.nabble.com/QGIS-Developer-f4099106.html

_______________________________________________
QGIS-Developer mailing list
[hidden email]
List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer