[gdal-dev] VSIS3 on digital globe multiview-stereo (NITF)

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[gdal-dev] VSIS3 on digital globe multiview-stereo (NITF)

Mike Pfaffenberger
Hi all,

I'm having an issue with VSIS3 on the Digital Globe multiview-stereo imagery collection.

Here is an example command I'm running --
gdal_translate -srcwin 000 000 1000 1000 /vsis3/glitch253/test2.ntf from_s3.nitf

So I'm simply cropping out an upper left 1000x1000 window. When I've done this previously on data such as Landsat, this command would run very fast, and only appear to download the necessary data.

The problem I'm having is that on this Digital Globe data, the command runs very slowly and appears to download the entire image.

Is there a workaround for this?

By the way I'm using GDAL 2.3.0dev on trunk compiled today.

Thanks in advance!



_______________________________________________
gdal-dev mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/gdal-dev
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: VSIS3 on digital globe multiview-stereo (NITF)

Even Rouault-2

Mike,

 

>

> I'm having an issue with VSIS3 on the Digital Globe multiview-stereo

> imagery collection.

>

> Here is an example command I'm running --

> gdal_translate -srcwin 000 000 1000 1000 /vsis3/glitch253/test2.ntf

> from_s3.nitf

>

> So I'm simply cropping out an upper left 1000x1000 window. When I've done

> this previously on data such as Landsat, this command would run very fast,

> and only appear to download the necessary data.

>

> The problem I'm having is that on this Digital Globe data, the command runs

> very slowly and appears to download the entire image.

>

> Is there a workaround for this?

 

I'm not sure if there's something to do on the GDAL side. This might strongly depend on the pixel layout of the source NITF file. Could you show the output of "gdalinfo /vsis3/glitch253/test2.ntf" ?

 

Even

 

--

Spatialys - Geospatial professional services

http://www.spatialys.com


_______________________________________________
gdal-dev mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/gdal-dev
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: VSIS3 on digital globe multiview-stereo (NITF)

Mike Pfaffenberger
Here's the gdalinfo output:

gdalinfo /vsis3/glitch253/test2.ntf
Driver: NITF/National Imagery Transmission Format
Files: /vsis3/glitch253/test2.ntf
Size is 43008, 44032
Coordinate System is `'
GCP Projection =
GEOGCS["WGS 84",
    DATUM["WGS_1984",
        SPHEROID["WGS 84",6378137,298.257223563,
            AUTHORITY["EPSG","7030"]],
        AUTHORITY["EPSG","6326"]],
    PRIMEM["Greenwich",0,
        AUTHORITY["EPSG","8901"]],
    UNIT["degree",0.0174532925199433,
        AUTHORITY["EPSG","9122"]],
    AUTHORITY["EPSG","4326"]]
GCP[  0]: Id=UpperLeft, Info=
          (0.5,0.5) -> (-58.5325,-34.5383333333333,0)
GCP[  1]: Id=UpperRight, Info=
          (43007.5,0.5) -> (-58.6852777777778,-34.5422222222222,0)
GCP[  2]: Id=LowerRight, Info=
          (43007.5,44031.5) -> (-58.685,-34.4083333333333,0)
GCP[  3]: Id=LowerLeft, Info=
          (0.5,44031.5) -> (-58.5327777777778,-34.4044444444444,0)
Metadata:
  NITF_ABPP=11
  NITF_CCS_COLUMN=0
  NITF_CCS_ROW=0
  NITF_CLEVEL=06
  NITF_CSDIDA_DAY=15
  NITF_CSDIDA_MONTH=MAR
  NITF_CSDIDA_OPERATION=000
  NITF_CSDIDA_PASS=10
  NITF_CSDIDA_PLATFORM_CODE=WV
  NITF_CSDIDA_PROCESS_TIME=20151202180732
  NITF_CSDIDA_PRODUCT_ID=P1
  NITF_CSDIDA_RESERVED_0=0000
  NITF_CSDIDA_RESERVED_1=00
  NITF_CSDIDA_RESERVED_2=01
  NITF_CSDIDA_RESERVED_3=N
  NITF_CSDIDA_RESERVED_4=N
  NITF_CSDIDA_SENSOR_ID=AA
  NITF_CSDIDA_SOFTWARE_VERSION_NUMBER=4.45.6.1
  NITF_CSDIDA_TIME=20150315140133
  NITF_CSDIDA_VEHICLE_ID=03
  NITF_CSDIDA_YEAR=2015
  NITF_CSEXRA_ALONG_SCAN_GSD=013.5
  NITF_CSEXRA_ANGLE_TO_NORTH=270.000
  NITF_CSEXRA_AZ_OF_OBLIQUITY=198.341
  NITF_CSEXRA_A_S_VERT_GSD=N/A
  NITF_CSEXRA_CIRCL_ERR=016
  NITF_CSEXRA_CROSS_SCAN_GSD=013.0
  NITF_CSEXRA_C_S_VERT_GSD=N/A
  NITF_CSEXRA_DYNAMIC_RANGE=01945
  NITF_CSEXRA_GEO_MEAN_GSD=013.3
  NITF_CSEXRA_GEO_MEAN_VERT_GSD=N/A
  NITF_CSEXRA_GRD_COVER=9
  NITF_CSEXRA_GSD_BETA_ANGLE=091.8
  NITF_CSEXRA_LINEAR_ERR=016
  NITF_CSEXRA_MAX_GSD=013.3
  NITF_CSEXRA_NUM_LINES=0044032
  NITF_CSEXRA_NUM_SAMPLES=43008
  NITF_CSEXRA_OBLIQUITY_ANGLE=16.568
  NITF_CSEXRA_PREDICTED_NIIRS=5.6
  NITF_CSEXRA_SENSOR=PAN
  NITF_CSEXRA_SNOW_DEPTH_CAT=9
  NITF_CSEXRA_SUN_AZIMUTH=048.094
  NITF_CSEXRA_SUN_ELEVATION=+47.090
  NITF_CSEXRA_TIME_FIRST_LINE_IMAGE=50493.612175
  NITF_CSEXRA_TIME_IMAGE_DURATION=-0002.160750
  NITF_ENCRYP=0
  NITF_FBKGC=126,126,126
  NITF_FDT=20151203163736
  NITF_FHDR=NITF02.10
  NITF_FSCATP=
  NITF_FSCAUT=
  NITF_FSCLAS=U
  NITF_FSCLSY=US
  NITF_FSCLTX=
  NITF_FSCODE=
  NITF_FSCOP=00000
  NITF_FSCPYS=00000
  NITF_FSCRSN=
  NITF_FSCTLH=0
  NITF_FSCTLN=
  NITF_FSDCDT=
  NITF_FSDCTP=
  NITF_FSDCXM=
  NITF_FSDG=
  NITF_FSDGDT=
  NITF_FSREL=
  NITF_FSSRDT=
  NITF_FTITLE=15MAR15WV031000015MAR15140133-P1BS-500497284070_01_P001         AAE 0AAAAABPABQ0
  NITF_IALVL=0
  NITF_IC=C8
  NITF_ICAT=VIS
  NITF_ICORDS=G
  NITF_IDATIM=20150315140133
  NITF_IDLVL=1
  NITF_IGEOLO=343218S0583157W343232S0584107W342430S0584106W342416S0583158W
  NITF_IID1=P109BED300
  NITF_IID2=15MAR15WV031000015MAR15140133-P1BS-500497284070_01_P001         AAE 0AAAAABPABQ0
  NITF_ILOC_COLUMN=0
  NITF_ILOC_ROW=0
  NITF_IMAG=1.0
  NITF_IMAGE_COMMENTS=The imagery and metadata data on this media is the property of                  DigitalGlobe and is licensed for use only. All use must be in                   accordance with the terms of the license that accompanies the media.            If the license is purchased under contract NMA 301 99 D003, use is              in accordance with the license therein                                         
  NITF_IMODE=B
  NITF_IREP=MONO
  NITF_ISCATP=
  NITF_ISCAUT=
  NITF_ISCLAS=U
  NITF_ISCLSY=US
  NITF_ISCLTX=
  NITF_ISCODE=
  NITF_ISCRSN=
  NITF_ISCTLH=0
  NITF_ISCTLN=
  NITF_ISDCDT=
  NITF_ISDCTP=
  NITF_ISDCXM=
  NITF_ISDG=
  NITF_ISDGDT=
  NITF_ISORCE=DigitalGlobe
  NITF_ISREL=
  NITF_ISSRDT=
  NITF_ONAME=
  NITF_OPHONE=
  NITF_OSTAID=NDL-W
  NITF_PIAIMC_CAMSPECS=
  NITF_PIAIMC_CLOUDCVR=000
  NITF_PIAIMC_COMGEN=00
  NITF_PIAIMC_ESD=Y
  NITF_PIAIMC_GENERATION=1
  NITF_PIAIMC_IDATUM=WGE
  NITF_PIAIMC_IELLIP=
  NITF_PIAIMC_IPROJ=
  NITF_PIAIMC_MEANGSD=00013.3
  NITF_PIAIMC_OTHERCOND=
  NITF_PIAIMC_PIAMSNNUM=
  NITF_PIAIMC_PREPROC=1R
  NITF_PIAIMC_PROJID=
  NITF_PIAIMC_SATTRACK=00000000
  NITF_PIAIMC_SENSMODE=PUSHBROOM
  NITF_PIAIMC_SENSNAME=WV03
  NITF_PIAIMC_SOURCE=VNIR: 1040010009BED300
  NITF_PIAIMC_SRP=Y
  NITF_PIAIMC_SUBQUAL=
  NITF_PJUST=R
  NITF_PVTYPE=INT
  NITF_STDIDC_ACQUISITION_DATE=20150315140133
  NITF_STDIDC_COUNTRY=AR
  NITF_STDIDC_END_COLUMN=042
  NITF_STDIDC_END_ROW=00043
  NITF_STDIDC_END_SEGMENT=AA
  NITF_STDIDC_LOCATION=3432S05837W
  NITF_STDIDC_MISSION=WV03
  NITF_STDIDC_OP_NUM=000
  NITF_STDIDC_PASS=10
  NITF_STDIDC_REPLAY_REGEN=000
  NITF_STDIDC_REPRO_NUM=00
  NITF_STDIDC_START_COLUMN=001
  NITF_STDIDC_START_ROW=00001
  NITF_STDIDC_START_SEGMENT=AA
  NITF_STDIDC_WAC=
  NITF_STYPE=BF01
  NITF_TGTID=
  NITF_USE00A_ANGLE_TO_NORTH=270
  NITF_USE00A_DYNAMIC_RANGE=02046
  NITF_USE00A_MAX_LP_SEG=043216
  NITF_USE00A_MEAN_GSD=013.3
  NITF_USE00A_N_REF=00
  NITF_USE00A_N_SEG=001
  NITF_USE00A_OBL_ANG=16.57
  NITF_USE00A_REV_NUM=03174
  NITF_USE00A_ROLL_ANG=-05.54
  NITF_USE00A_SUN_AZ=048.1
  NITF_USE00A_SUN_EL=+47.1
Image Structure Metadata:
  COMPRESSION=JPEG2000
Subdatasets:
  SUBDATASET_1_NAME=NITF_IM:0:/vsis3/glitch253/test2.ntf
  SUBDATASET_1_DESC=Image 1 of /vsis3/glitch253/test2.ntf
  SUBDATASET_2_NAME=NITF_IM:1:/vsis3/glitch253/test2.ntf
  SUBDATASET_2_DESC=Image 2 of /vsis3/glitch253/test2.ntf
RPC Metadata:
  HEIGHT_OFF=30
  HEIGHT_SCALE=502
  LAT_OFF=-34.4734
  LAT_SCALE=0.0703
  LINE_DEN_COEFF=1 -7.820395e-05 -2.669502e-05 -8.850493e-06 1.414223e-05 -1.548651e-07 -1.060036e-05 4.346602e-05 -0.0001314038 5.799668e-05 2.949456e-07 0 7.908338000000001e-06 0 9.118064000000001e-08 -3.922194e-05 -1.72329e-08 0 -2.018329e-06 0
  LINE_NUM_COEFF=0.0002958248 -0.02963833 1.049996 0.02072787 6.667386e-05 1.687254e-06 2.64655e-06 -0.0005267895 -0.0002565297 -1.435182e-06 -6.953109e-07 -1.344296e-06 -9.874576e-06 -1.732024e-06 4.611917e-05 0.0002160089 6.110935e-05 9.296905e-07 7.265858e-06 1.203192e-06
  LINE_OFF=21607
  LINE_SCALE=21608
  LONG_OFF=-58.6088
  LONG_SCALE=0.077
  MAX_LAT=-34.43825
  MAX_LONG=-58.5703
  MIN_LAT=-34.50855
  MIN_LONG=-58.6473
  SAMP_DEN_COEFF=1 -1.469918e-05 -0.0006828607 -0.0004498713 -2.440384e-05 1.574905e-07 -6.752665e-07 2.77071e-06 -8.888868e-06 -1.083016e-06 -3.791422e-08 0 -4.670506e-07 0 7.583037e-08 -1.150001e-06 0 0 -4.552579e-08 0
  SAMP_NUM_COEFF=-0.00126101 -1.009822 -3.573786e-05 -0.007359501 -0.0006781537 -0.0004362946 0.0001916278 0.001249532 -0.0006199303 1.366175e-06 -7.346167e-07 3.531102e-06 -5.858416e-06 7.633005e-07 -5.325952e-06 0.0002869756 4.350662e-07 7.059197e-07 1.735672e-05 1.023288e-08
  SAMP_OFF=21249
  SAMP_SCALE=21250
Corner Coordinates:
Upper Left  (    0.0,    0.0)
Lower Left  (    0.0,44032.0)
Upper Right (43008.0,    0.0)
Lower Right (43008.0,44032.0)
Center      (21504.0,22016.0)
Band 1 Block=1024x1024 Type=UInt16, ColorInterp=Gray
  Overviews: 21504x22016, 10752x11008, 5376x5504, 2688x2752, 1344x1376
  Overviews: arbitrary
  Image Structure Metadata:
    COMPRESSION=JPEG2000
    NBITS=11


On Mon, Jul 24, 2017 at 3:59 AM, Even Rouault <[hidden email]> wrote:

Mike,

 

>

> I'm having an issue with VSIS3 on the Digital Globe multiview-stereo

> imagery collection.

>

> Here is an example command I'm running --

> gdal_translate -srcwin 000 000 1000 1000 /vsis3/glitch253/test2.ntf

> from_s3.nitf

>

> So I'm simply cropping out an upper left 1000x1000 window. When I've done

> this previously on data such as Landsat, this command would run very fast,

> and only appear to download the necessary data.

>

> The problem I'm having is that on this Digital Globe data, the command runs

> very slowly and appears to download the entire image.

>

> Is there a workaround for this?

 

I'm not sure if there's something to do on the GDAL side. This might strongly depend on the pixel layout of the source NITF file. Could you show the output of "gdalinfo /vsis3/glitch253/test2.ntf" ?

 

Even

 

--

Spatialys - Geospatial professional services

http://www.spatialys.com



_______________________________________________
gdal-dev mailing list
[hidden email]
https://lists.osgeo.org/mailman/listinfo/gdal-dev
Loading...