stackSentinel.py processing error

Added by Heming Liao about 1 month ago

Dear community,

I am running stackSentinel.py module and got error at the first step. I have tried to search in the forum but didn't find similar posting.

My command is as following:
(base) heming@heming-Latitude-7400:~/Documents/Sentinel-1$ stackSentinel.py -s ./SLCs/ -d ./DEMs/demLat_N40_N43_Lon_W096_W091.dem.wgs84 -a ./aux/ -o ./orbits -c 1
This is the Open Source version of ISCE.
Some of the workflows depend on a separate licensed package.
To obtain the licensed package, please make a request for ISCE
through the website: https://download.jpl.nasa.gov/ops/request/index.cfm.
Alternatively, if you are a member, or can become a member of WinSAR
you may be able to obtain access to a version of the licensed sofware at
https://winsar.unavco.org/software/isce
Number of SAFE files found: 3
Traceback (most recent call last):
File "/home/heming/anaconda3/lib/python3.7/site-packages/isce/contrib/stack/topsStack/stackSentinel.py", line 773, in <module>
main()
File "/home/heming/anaconda3/lib/python3.7/site-packages/isce/contrib/stack/topsStack/stackSentinel.py", line 737, in main
acquisitionDates, stackMasterDate, slaveDates, safe_dict, updateStack = checkCurrentStatus(inps)
File "/home/heming/anaconda3/lib/python3.7/site-packages/isce/contrib/stack/topsStack/stackSentinel.py", line 613, in checkCurrentStatus
acquisitionDates, stackMasterDate, slaveDates, safe_dict = get_dates(inps)
File "/home/heming/anaconda3/lib/python3.7/site-packages/isce/contrib/stack/topsStack/stackSentinel.py", line 246, in get_dates
bbox_poly = [[bbox0,bbox2],[bbox0,bbox3],[bbox1,bbox3],[bbox1,bbox2]]
UnboundLocalError: local variable 'bbox' referenced before assignment

I then added a bounding box for the AOI, the above code then run without any error message (strange, I suspect without setting bounding it will process entire data. Not sure how this error happened).
However, I got error when I tried to run the first run_01_unpack_topo_master step. The code prompts that it cann't open the dem*.vrt file(output is attached). This file however is there. I double checked path and it is right.

Can anyone shed some light on this issue here? Thank you in advance.

Heming

output (12.5 kB)


Replies (8)

RE: stackSentinel.py processing error - Added by Heresh Fattahi about 1 month ago

The path in the xml file of the DEM might not be correct.
Try this command to fix the xml:

fixImageXml.py -f -i ./DEMs/demLat_N40_N43_Lon_W096_W091.dem.wgs84

Heresh

RE: stackSentinel.py processing error - Added by Heming Liao about 1 month ago

Hi Heresh,

Thank you for your quick response. I manually copied out the dem file to the folder where I run the command run_01_unpack_topo_master. That also solved the problem and the program is running with the error message.

I will try your solution later.

Thank you.

Best,
Heming

RE: stackSentinel.py processing error - Added by Piyush Agram about 1 month ago

I would recommend using full paths for all folders when setting up the processing. This will let you run the commands from any folder.

RE: stackSentinel.py processing error - Added by Heresh Fattahi about 1 month ago

Hi Heming,

Feel free to post the error messages. As Piyush suggested being careful about the Paths reduces the errors.

Heresh

RE: stackSentinel.py processing error - Added by Heming Liao about 1 month ago

Piyush Agram wrote:

I would recommend using full paths for all folders when setting up the processing. This will let you run the commands from any folder.

Thank you for the suggestion, piyush.

Best,
Heming

RE: stackSentinel.py processing error - Added by Heming Liao about 1 month ago

Heresh Fattahi wrote:

Hi Heming,

Feel free to post the error messages. As Piyush suggested being careful about the Paths reduces the errors.

Heresh

Heresh, thank you for your reply.

Best,
Heming

RE: stackSentinel.py processing error - Added by Heming Liao about 1 month ago

Heming Liao wrote:

Hi Heresh,

Thank you for your quick response. I manually copied out the dem file to the folder where I run the command run_01_unpack_topo_master. That also solved the problem and the program is running with the error message.

I will try your solution later.

Thank you.

Best,
Heming

I encountered a new error message when I run with other datasets for the same area.

This steps works fine.
heming@heming-Latitude-7400:/media/heming/Samsung_T5/Sentinel_proc/stack_proc$ stackSentinel.py -s /media/heming/Samsung_T5/Sentinel_proc/SLCs/ -d /media/heming/Samsung_T5/Sentinel_proc/DEMs/demLat_N40_N43_Lon_W096_W091.dem.wgs84 -b '41.302 42.026 -94.012 -93.353' -a /media/heming/Samsung_T5/Sentinel_proc/aux/ -o /media/heming/Samsung_T5/Sentinel_proc/orbits -m 20190902 -c 1 -z 1 -r 5

Then in the run_file folder, the first step throw out some error (I attached the run_01_output file below)

heming@heming-Latitude-7400:/media/heming/Samsung_T5/Sentinel_proc/stack_proc/run_files$ bash run_01_unpack_topo_master >run_01_output
Traceback (most recent call last):
File "/home/heming/anaconda3/lib/python3.7/site-packages/isce/contrib/stack/topsStack/SentinelWrapper.py", line 251, in <module>
main(args.start,args.end)
File "/home/heming/anaconda3/lib/python3.7/site-packages/isce/contrib/stack/topsStack/SentinelWrapper.py", line 242, in main
cfgParser.runCmd()
File "/home/heming/anaconda3/lib/python3.7/site-packages/isce/contrib/stack/topsStack/SentinelWrapper.py", line 54, in runCmd
func_modules.main(self.funcParams[section])
File "/home/heming/anaconda3/lib/python3.7/site-packages/isce/contrib/stack/topsStack/topo.py", line 108, in main
bbox = [np.min(boxes[:,0]), np.max(boxes[:,1]), np.min(boxes[:,2]), np.max(boxes[:,3])]
IndexError: too many indices for array

I degubed into the topo.py file and the indexError message is because 'boxes' is empty. Based on the run_01_output of message 'No suitable orbit file found.', I think the problem may be the orbit path. But I cannot figure out how does this happen and how to correct it. this time I used the full path in my processing and I also went to check the config_master file and the orbit address is correct.

I also checked the orbit files and they look right to me.

(base) heming@heming-Latitude-7400:/media/heming/Samsung_T5/Sentinel_proc/orbits$ ls ./*/*
./20190716/S1A_OPER_AUX_POEORB_OPOD_20190805T120636_V20190715T225942_20190717T005942.EOF ./20190902/S1A_OPER_AUX_POEORB_OPOD_20190922T120643_V20190901T225942_20190903T005942.EOF
./20190728/S1A_OPER_AUX_POEORB_OPOD_20190817T120623_V20190727T225942_20190729T005942.EOF ./20190914/S1A_OPER_AUX_POEORB_OPOD_20191004T120626_V20190913T225942_20190915T005942.EOF
./20190809/S1A_OPER_AUX_POEORB_OPOD_20190829T120736_V20190808T225942_20190810T005942.EOF ./20190926/S1A_OPER_AUX_POEORB_OPOD_20191016T120700_V20190925T225942_20190927T005942.EOF
./20190821/S1A_OPER_AUX_POEORB_OPOD_20190910T120717_V20190820T225942_20190822T005942.EOF ./20191008/S1A_OPER_AUX_POEORB_OPOD_20191028T120831_V20191007T225942_20191009T005942.EOF
(base) heming@heming-Latitude-7400:/media/heming/Samsung_T5/Sentinel_proc/orbits$ ls ../SLCs
S1A_IW_SLC__1SDV_20190716T001333_20190716T001359_028135_032D7F_9E58.zip S1A_IW_SLC__1SDV_20190902T001336_20190902T001402_028835_034468_56AA.zip
S1A_IW_SLC__1SDV_20190728T001334_20190728T001400_028310_0332D6_F367.zip S1A_IW_SLC__1SDV_20190914T001336_20190914T001402_029010_034A7A_3348.zip
S1A_IW_SLC__1SDV_20190809T001334_20190809T001401_028485_033839_1994.zip S1A_IW_SLC__1SDV_20190926T001337_20190926T001403_029185_03506F_BAA6.zip
S1A_IW_SLC__1SDV_20190821T001335_20190821T001401_028660_033E4F_6BAF.zip S1A_IW_SLC__1SDV_20191008T001337_20191008T001403_029360_035678_4FA3.zip

Does anyone have any idea about the error here? Thanks.

Best,
Heming

run_01_output (4.6 kB)

RE: stackSentinel.py processing error - Added by Heming Liao about 1 month ago

Use the successful example I run, I managed to get the program work by manually edit the config_master file in the configs folder.

Replace: orbitdir : /media/heming/Samsung_T5/Sentinel_proc/orbits with the following line:

orbit : /media/heming/Samsung_T5/Sentinel_proc/orbits/20190716/S1A_OPER_AUX_POEORB_OPOD_20190805T120636_V20190715T225942_20190717T005942.EOF

My code is working now but I haven't figured out how the issues happened, though I tried to use full path in my processing.

Best,
Heming

(1-8/8)