r.terraflow error

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

r.terraflow error

Mihai Niculita
This post has NOT been accepted by the mailing list yet.
Hi all,

I use GRASS 6.4.1 to run r.waterflow on a GB raster.
GRASS 6.4.1 is the official Windows binary. The PC runs Windows Server 2003.
I have enough memory (64 GB), enough space on disk (400 GB), but i get this error:

r.terraflow -s --overwrite --verbose elevation=SRTM1_USGS_mdenoise_noSinks@PERMANENT filled=filled_dem direction=flow_dir swatershed=sink_watershed accumulation=flow_accum tci=tci memory=50000 STREAM_DIR=D: stats=D:/stats.out
SFD (D8) flow direction
D8CUT=999999986991104.000000
Memory size: 848.00M (889192448) bytes
Memory manager registering memory in MM_WARN_ON_MEMORY_EXCEEDED mode.
cell SRTM1_USGS_mdenoise_noSinks header compatible with region header
Elevation stored as FLOAT (4B)
Region size is 18963 x 27330
STREAM temporary files in D:  (THESE INTERMEDIATE STREAMS
WILL NOT BE DELETED IN CASE OF ABNORMAL TERMINATION OF THE
PROGRAM. TO SAVE SPACE PLEASE DELETE THESE FILES MANUALLY!)
file D:/stats.out exists - renaming.
Reading data from <SRTM1_USGS_mdenoise_noSinks> to stream <D:/STREAM_a03348>
------------------------------
COMPUTING FLOW DIRECTIONS
classifying nodata (inner & boundary)
finding nodata
ERROR: AMI_STREAM::stream_len(): ftell(fp) failed : No such
file or directory
D:/STREAM_d03348: No such file or directory
total elements=518258790, nodata elements=206382770
largest temporary files:
FILL: -1042278832 [518258790 elements, 56B each]
FLOW: -819722176 [311876020 elements, 80B each]
Will need at least -2084557664 space available in D:
(Tue Jun 26 00:02:36 2012) Command finished (2258 sec)

I clean every time the temporal which reside on D:/.
The module make temporals named STREAM_abcdxxxxx, and It seems the one with d makes the problem.

Any ideea?
Thanks

Mihai
Reply | Threaded
Open this post in threaded view
|

Re: r.terraflow error

fbiles
This post has NOT been accepted by the mailing list yet.
Hello Mihai & List,

Did you ever get an answer for this or resolve the problem?  
I am getting the EXACT same error.
My DEM is about the same number of rows and columns as yours; however I am running Windows XP with only 3Gb memory. Running GRASS 6.4.3RC2. Another difference is I'm running the MFD flow direction model instead of the SFD.

Here's what I get:

r.terraflow --verbose elevation=noyak_fel filled=noyak_filled direction=noyak_dir swatershed=noyak_sw  accumulation=noyak_acc tci=noyak_grasstci memory=800 STREAM_DIR=C:\Workspace
MFD flow direction
D8CUT=999999986991104.000000
Memory size: 800.00M (838860800) bytes
Memory manager registering memory in MM_WARN_ON_MEMORY_EXCEEDED mode.
cell noyak_fel header compatible with region header
Elevation stored as FLOAT (4B)
Region size is 27959 x 18646
STREAM temporary files in C:\Workspace  (THESE INTERMEDIATE
STREAMS WILL NOT BE DELETED IN CASE OF ABNORMAL TERMINATION
OF THE PROGRAM. TO SAVE SPACE PLEASE DELETE THESE FILES
MANUALLY!)
Reading data from <noyak_fel> to stream <C:\Workspace/STREAM_a06044>
------------------------------
COMPUTING FLOW DIRECTIONS
classifying nodata (inner & boundary)
finding nodata
ERROR: AMI_STREAM::stream_len(): ftell(fp) failed : Invalid
argument
C:\Workspace/STREAM_d06044: Invalid argument
total elements=521323514, nodata elements=416595839
largest temporary files:
FILL: -870654288 [521323514 elements, 56B each]
FLOW: -211720592 [104727675 elements, 80B each]
Will need at least -1741308576 space available in C:\Workspace
(Thu Jan 10 22:44:11 2013) Command finished (39 min 39 sec)    

Ideas?
--Frances


mihai niculita wrote
Hi all,

I use GRASS 6.4.1 to run r.waterflow on a GB raster.
GRASS 6.4.1 is the official Windows binary. The PC runs Windows Server 2003.
I have enough memory (64 GB), enough space on disk (400 GB), but i get this error:

r.terraflow -s --overwrite --verbose elevation=SRTM1_USGS_mdenoise_noSinks@PERMANENT filled=filled_dem direction=flow_dir swatershed=sink_watershed accumulation=flow_accum tci=tci memory=50000 STREAM_DIR=D: stats=D:/stats.out
SFD (D8) flow direction
D8CUT=999999986991104.000000
Memory size: 848.00M (889192448) bytes
Memory manager registering memory in MM_WARN_ON_MEMORY_EXCEEDED mode.
cell SRTM1_USGS_mdenoise_noSinks header compatible with region header
Elevation stored as FLOAT (4B)
Region size is 18963 x 27330
STREAM temporary files in D:  (THESE INTERMEDIATE STREAMS
WILL NOT BE DELETED IN CASE OF ABNORMAL TERMINATION OF THE
PROGRAM. TO SAVE SPACE PLEASE DELETE THESE FILES MANUALLY!)
file D:/stats.out exists - renaming.
Reading data from <SRTM1_USGS_mdenoise_noSinks> to stream <D:/STREAM_a03348>
------------------------------
COMPUTING FLOW DIRECTIONS
classifying nodata (inner & boundary)
finding nodata
ERROR: AMI_STREAM::stream_len(): ftell(fp) failed : No such
file or directory
D:/STREAM_d03348: No such file or directory
total elements=518258790, nodata elements=206382770
largest temporary files:
FILL: -1042278832 [518258790 elements, 56B each]
FLOW: -819722176 [311876020 elements, 80B each]
Will need at least -2084557664 space available in D:
(Tue Jun 26 00:02:36 2012) Command finished (2258 sec)

I clean every time the temporal which reside on D:/.
The module make temporals named STREAM_abcdxxxxx, and It seems the one with d makes the problem.

Any ideea?
Reply | Threaded
Open this post in threaded view
|

Re: r.terraflow error

fbiles
This post has NOT been accepted by the mailing list yet.
In reply to this post by Mihai Niculita
Hello Mihai & List,

Did you ever get an answer for this or resolve the problem?  
I am getting the EXACT same error.
My DEM is about the same number of rows and columns as yours; however I am running Windows XP with only 3Gb memory. Running GRASS 6.4.3RC2. Another difference is I'm running the MFD flow direction model instead of the SFD.

Here's what I get:

r.terraflow --verbose elevation=noyak_fel filled=noyak_filled direction=noyak_dir swatershed=noyak_sw  accumulation=noyak_acc tci=noyak_grasstci memory=800 STREAM_DIR=C:\Workspace
MFD flow direction
D8CUT=999999986991104.000000
Memory size: 800.00M (838860800) bytes
Memory manager registering memory in MM_WARN_ON_MEMORY_EXCEEDED mode.
cell noyak_fel header compatible with region header
Elevation stored as FLOAT (4B)
Region size is 27959 x 18646
STREAM temporary files in C:\Workspace  (THESE INTERMEDIATE
STREAMS WILL NOT BE DELETED IN CASE OF ABNORMAL TERMINATION
OF THE PROGRAM. TO SAVE SPACE PLEASE DELETE THESE FILES
MANUALLY!)
Reading data from <noyak_fel> to stream <C:\Workspace/STREAM_a06044>
------------------------------
COMPUTING FLOW DIRECTIONS
classifying nodata (inner & boundary)
finding nodata
ERROR: AMI_STREAM::stream_len(): ftell(fp) failed : Invalid
argument
C:\Workspace/STREAM_d06044: Invalid argument
total elements=521323514, nodata elements=416595839
largest temporary files:
FILL: -870654288 [521323514 elements, 56B each]
FLOW: -211720592 [104727675 elements, 80B each]
Will need at least -1741308576 space available in C:\Workspace
(Thu Jan 10 22:44:11 2013) Command finished (39 min 39 sec)    

Ideas?
--Frances


mihai niculita wrote
Hi all,

I use GRASS 6.4.1 to run r.waterflow on a GB raster.
GRASS 6.4.1 is the official Windows binary. The PC runs Windows Server 2003.
I have enough memory (64 GB), enough space on disk (400 GB), but i get this error:

r.terraflow -s --overwrite --verbose elevation=SRTM1_USGS_mdenoise_noSinks@PERMANENT filled=filled_dem direction=flow_dir swatershed=sink_watershed accumulation=flow_accum tci=tci memory=50000 STREAM_DIR=D: stats=D:/stats.out
SFD (D8) flow direction
D8CUT=999999986991104.000000
Memory size: 848.00M (889192448) bytes
Memory manager registering memory in MM_WARN_ON_MEMORY_EXCEEDED mode.
cell SRTM1_USGS_mdenoise_noSinks header compatible with region header
Elevation stored as FLOAT (4B)
Region size is 18963 x 27330
STREAM temporary files in D:  (THESE INTERMEDIATE STREAMS
WILL NOT BE DELETED IN CASE OF ABNORMAL TERMINATION OF THE
PROGRAM. TO SAVE SPACE PLEASE DELETE THESE FILES MANUALLY!)
file D:/stats.out exists - renaming.
Reading data from <SRTM1_USGS_mdenoise_noSinks> to stream <D:/STREAM_a03348>
------------------------------
COMPUTING FLOW DIRECTIONS
classifying nodata (inner & boundary)
finding nodata
ERROR: AMI_STREAM::stream_len(): ftell(fp) failed : No such
file or directory
D:/STREAM_d03348: No such file or directory
total elements=518258790, nodata elements=206382770
largest temporary files:
FILL: -1042278832 [518258790 elements, 56B each]
FLOW: -819722176 [311876020 elements, 80B each]
Will need at least -2084557664 space available in D:
(Tue Jun 26 00:02:36 2012) Command finished (2258 sec)

I clean every time the temporal which reside on D:/.
The module make temporals named STREAM_abcdxxxxx, and It seems the one with d makes the problem.

Any ideea?
Reply | Threaded
Open this post in threaded view
|

Re: r.terraflow error

fbiles
This post has NOT been accepted by the mailing list yet.
In reply to this post by Mihai Niculita
I think I answered my question by clipping out a small portion of my project area from the original DEM and running r.terraflow on the clipped portion.  The process completed successfully.  The problem seems to be a memory issue. I.e., my computer doesn't have enough to run the entire original file.