Re: gdal-dev Digest, Vol 45, Issue 56

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Re: gdal-dev Digest, Vol 45, Issue 56

Michael Workman
Frank

Formerly from [hidden email], switching to a different email. Easier for me to read and format.

Here are answers to questions you asked:
~/project/kakadu-6.0/lib> ls -la
total 2032
drwxr-xr-x  9 jworkman jworkman    4096 Feb 28 12:54 .
drwxr-xr-x 11 jworkman jworkman    4096 Jan 24 11:29 ..
-rw-rw-r--  1 jworkman jworkman 1164722 Feb 28 12:53 libkdu.a
-rwxrwxr-x  1 jworkman jworkman  813887 Feb 28 12:53 libkdu_v60R.so
drwxr-xr-x  2 jworkman jworkman    4096 Feb 21 15:38 Linux-x86-32-gcc
drwxr-xr-x  2 jworkman jworkman    4096 Feb 28 12:54 Linux-x86-64-gcc
drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Mac-PPC-gcc
drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Mac-x86-32-gcc
drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Mac-x86-64-gcc
drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Solaris-gcc
drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Solaris-sunpro
~/project/kakadu-6.0/lib> nm libkdu.a | grep add_queue
                 U _ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
                 U _ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
0000000000000ca0 T _ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
                 U _ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
That looks pretty much like what you sent me.

I do not have admin privileges where I am working, so my kakadu build is under my home directory. Any other suggestions?

Thanks for the reply.

Mike

Original Message:
-----------------
From: Frank Warmerdam [hidden email]
Date: Fri, 29 Feb 2008 11:09:32 -0500
To: [hidden email], [hidden email]
Subject: Re: [gdal-dev] Problems compiling w jp2kak


[hidden email] wrote:
> After kakadu is built and libraries are in the kakadu-6.0/lib directory, cd
> to gdal-1.5.0, ran configure:
>     configure --with-ogdi=no --with-kakadu=/home/mw/project/kakadu-6.0
>     --prefix=/home/jworkman/project/gdal --with-libtiff=internal
> Running make results in over 2000 lines of output that ends with the
> following:
>     libtool: link: g++ gdalinfo.o -o .libs/gdalinfo
>     /home/jworkman/project/gdal-1.5.0/.libs/libgdal.so -L/usr/local/lib
>     -L/usr/lib -L/home/jworkman/project/kakadu-6.0/lib -L/usr/kerberos/lib64
>     /usr/local/lib/libgeos_c.so /usr/local/lib/libgeos.so -lsqlite3
>     /usr/lib64/libexpat.so -ljpeg -lpng -lrt -lkdu -lcurl -ldl -lgssapi_krb5
>     -lkrb5 -lk5crypto -lkrb5support -lcom_err -lresolv /usr/lib64/libidn.so
>     -lssl -lcrypto -lz -Wl,-rpath -Wl,/home/jworkman/project/gdal/lib
>     -Wl,-rpath -Wl,/usr/lib64
...
>     /home/jworkman/project/gdal-1.5.0/.libs/libgdal.so: undefined reference
>     to `kdu_thread_entity::add_queue(kdu_worker*, kdu_thread_queue*, char
>     const*, long long)'
>     /home/jworkman/project/gdal-1.5.0/.libs/libgdal.so: undefined reference
>     to `kdu_codestream::create(kdu_compressed_source*, kdu_thread_env*)'
>     collect2: ld returned 1 exit status
>     make[1]: *** [gdalinfo] Error 1
>     make[1]: Leaving directory `/home/jworkman/project/gdal-1.5.0/apps'
>     make: *** [apps-target] Error 2


Mike,

Where is libkdu.a?  Is it in /home/jworkman/project/kakadu-6.0/lib or
in /home/jworkman/project/kakadu-6.0/lib/Linux-x86-64-gcc?  I don't see
any complaints about not finding libkdu.a but stuff isn't found that I would
expect to be found.

I see that my local build is only working because I also installed kakadu
into /usr/local/lib.

BTW, what do you get when you do:
warmerda@gdal64[11]% nm libkdu.a | grep add_queue
                  U
_ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
                  U
_ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
0000000000001190 T
_ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
                  U
_ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx

There needs to be at least one line reported with the " T " indicating
a definition of this method. If not, perhaps your build of Kakadu is
flawed in some way.

I'm sorry for the sorry state of kakadu building. It seems to still be
hairy.  Please feel free to update the trac wiki when you resolve the
issue.

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up   | Frank Warmerdam, [hidden email]
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | President OSGeo, http://osgeo.org

_______________________________________________
gdal-dev mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/gdal-dev
Reply | Threaded
Open this post in threaded view
|

GDAL 1.5.0 is slow

Michael Workman
Frank

Was able to fix my 64 bit problem by adding /usr/lib64 to my LD_LIBRARY_PATH. Compiles and links fine now. Onward to other issues.

I am having problems with the time it takes to run GDAL apps. For example, there are a number of versions of gdalinfo on my system. A few:
~> <FWTools-2.0>/bin_safe/gdalinfo --version
GDAL 1.5dev, FWTools 2.0.0, released 2007/11/12
~> <gdal-1.5.0>/apps/gdalinfo --version
GDAL 1.5.0, released 2007/12/18
~> /usr/local/bin/gdalinfo --version
GDAL 1.3.2.0, released 2006/05/02

When I am in a directory with a huge number of NITF files and run the gdalinfo v1.5 versions on a single filename, it takes one to two minutes to return. If I run gdalinfo v1.3.2, it returns immediately. If I take that same file and place it by itself under my home directory, All three versions return quickly. I was told this might have been addressed in the list before, but I have not found where.

Any ideas what is happening?

Thanks

Mike Workman

Frank Warmerdam wrote:
Michael Workman wrote:
Frank

Formerly from [hidden email], switching to a different email. Easier for me to read and format.

Here are answers to questions you asked:

    ~/project/kakadu-6.0/lib> ls -la
    total 2032
    drwxr-xr-x  9 jworkman jworkman    4096 Feb 28 12:54 .
    drwxr-xr-x 11 jworkman jworkman    4096 Jan 24 11:29 ..
    -rw-rw-r--  1 jworkman jworkman 1164722 Feb 28 12:53 libkdu.a
    -rwxrwxr-x  1 jworkman jworkman  813887 Feb 28 12:53 libkdu_v60R.so
    drwxr-xr-x  2 jworkman jworkman    4096 Feb 21 15:38 Linux-x86-32-gcc
    drwxr-xr-x  2 jworkman jworkman    4096 Feb 28 12:54 Linux-x86-64-gcc
    drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Mac-PPC-gcc
    drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Mac-x86-32-gcc
    drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Mac-x86-64-gcc
    drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Solaris-gcc
    drwxr-xr-x  2 jworkman jworkman    4096 Aug 31 02:40 Solaris-sunpro
    ~/project/kakadu-6.0/lib> nm libkdu.a | grep add_queue
                     U
    _ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
                     U
    _ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
    0000000000000ca0 T
    _ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx
                     U
    _ZN17kdu_thread_entity9add_queueEP10kdu_workerP16kdu_thread_queuePKcx

That looks pretty much like what you sent me.

I do not have admin privileges where I am working, so my kakadu build is under my home directory. Any other suggestions?

Mike,

I'm at a bit of a loss.  Any chance there is an older libkdu.a on your
system somewhere that might be getting picked up?

Sorry not to be more help.

Best regards,

_______________________________________________
gdal-dev mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/gdal-dev
Reply | Threaded
Open this post in threaded view
|

Re: GDAL 1.5.0 is slow

Frank Warmerdam
Michael Workman wrote:

> Frank
>
> Was able to fix my 64 bit problem by adding /usr/lib64 to my LD_LIBRARY_PATH.
> Compiles and links fine now. Onward to other issues.
>
> I am having problems with the time it takes to run GDAL apps. For example, there
> are a number of versions of gdalinfo on my system. A few:
>
>     ~> <FWTools-2.0>/bin_safe/gdalinfo --version
>     GDAL 1.5dev, FWTools 2.0.0, released 2007/11/12
>     ~> <gdal-1.5.0>/apps/gdalinfo --version
>     GDAL 1.5.0, released 2007/12/18
>     ~> /usr/local/bin/gdalinfo --version
>     GDAL 1.3.2.0, released 2006/05/02
>
> When I am in a directory with a huge number of NITF files and run the gdalinfo
> v1.5 versions on a single filename, it takes one to two minutes to return. If I
> run gdalinfo v1.3.2, it returns immediately. If I take that same file and place
> it by itself under my home directory, All three versions return quickly. I was
> told this might have been addressed in the list before, but I have not found where.
>
> Any ideas what is happening?

Mike,

This is:

   http://trac.osgeo.org/gdal/ticket/2158

For reasons that are not clear to me, scanning the list of files in
a directory with a lot of files is inordinately expensive in some
situations.  There is a patch that allows working around this problem
though I have yet to make a final decision on what to do about it.

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up   | Frank Warmerdam, [hidden email]
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | President OSGeo, http://osgeo.org

_______________________________________________
gdal-dev mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/gdal-dev
Reply | Threaded
Open this post in threaded view
|

RE: Re: GDAL 1.5.0 is slow

Ed McNierney-4
Mike -

What is the filesystem on the volume holding the NITF files, and is it a local or network drive?  If network, what network protocol is used?

I had a theory about the cause of this symptom earlier, and your info would help be either confirm or discredit that theory - thanks.

        - Ed

Ed McNierney
Chief Mapmaker
Demand Media / TopoZone.com
73 Princeton Street, Suite 305
North Chelmsford, MA  01863
Phone: 978-251-4242, Fax: 978-251-1396
[hidden email]

-----Original Message-----
From: [hidden email] [mailto:[hidden email]] On Behalf Of Frank Warmerdam
Sent: Wednesday, March 05, 2008 2:40 PM
To: Michael Workman
Cc: [hidden email]
Subject: [gdal-dev] Re: GDAL 1.5.0 is slow

Michael Workman wrote:

> Frank
>
> Was able to fix my 64 bit problem by adding /usr/lib64 to my LD_LIBRARY_PATH.
> Compiles and links fine now. Onward to other issues.
>
> I am having problems with the time it takes to run GDAL apps. For example, there
> are a number of versions of gdalinfo on my system. A few:
>
>     ~> <FWTools-2.0>/bin_safe/gdalinfo --version
>     GDAL 1.5dev, FWTools 2.0.0, released 2007/11/12
>     ~> <gdal-1.5.0>/apps/gdalinfo --version
>     GDAL 1.5.0, released 2007/12/18
>     ~> /usr/local/bin/gdalinfo --version
>     GDAL 1.3.2.0, released 2006/05/02
>
> When I am in a directory with a huge number of NITF files and run the gdalinfo
> v1.5 versions on a single filename, it takes one to two minutes to return. If I
> run gdalinfo v1.3.2, it returns immediately. If I take that same file and place
> it by itself under my home directory, All three versions return quickly. I was
> told this might have been addressed in the list before, but I have not found where.
>
> Any ideas what is happening?

Mike,

This is:

   http://trac.osgeo.org/gdal/ticket/2158

For reasons that are not clear to me, scanning the list of files in
a directory with a lot of files is inordinately expensive in some
situations.  There is a patch that allows working around this problem
though I have yet to make a final decision on what to do about it.

Best regards,
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up   | Frank Warmerdam, [hidden email]
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | President OSGeo, http://osgeo.org

_______________________________________________
gdal-dev mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/gdal-dev
_______________________________________________
gdal-dev mailing list
[hidden email]
http://lists.osgeo.org/mailman/listinfo/gdal-dev