Multilevel Processing Issues with Seadas

Please enter here to ask a question about any NASA Science related topics!
catevans
Posts: 13
Joined: Wed Jun 02, 2021 9:47 am America/New_York

Multilevel Processing Issues with Seadas

by catevans » Wed Jun 02, 2021 9:56 am America/New_York

Hello,

I am converting a series of GOCI L1 files into L2 with the l2gen tool in Seadas. If done individually in the OCSWW window it works fine, however when trying to do multiple images with the multilevel_processor tool I keep getting this error:

execution exception: java.io.IOException: multilevel_processor failed with exit code 1.
Check log for more details.
Error! File /Users/catherine/Desktop/Seadas/IO_OCSSW_PARAMS/ifile_list specified the following input files which could not be located:
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906001644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906011644.he5


In this instance a list for the directory and file names have been put into the ifile_list file. There are 8 files it should be processing if it would work, all in the same usr/Desktop/GOCI_L1/ directory. I'm also unsure if it is my java that's not working, but if that were the case then I believe that running a single image through the l2gen would cause problems as well. Does anyone have any idea why it's returning this error? Thanks.

Tags:

OB SeaDAS - xuanyang02
Subject Matter Expert
Subject Matter Expert
Posts: 171
Joined: Tue Feb 09, 2021 5:42 pm America/New_York
Answers: 1

Re: Multilevel Processing Issues with Seadas

by OB SeaDAS - xuanyang02 » Wed Jun 02, 2021 12:54 pm America/New_York

Can you share the content of /Users/catherine/Desktop/Seadas/IO_OCSSW_PARAMS/ifile_list?

Were the other 6 L2 files created to your desired directory?

catevans
Posts: 13
Joined: Wed Jun 02, 2021 9:47 am America/New_York

Re: Multilevel Processing Issues with Seadas

by catevans » Wed Jun 02, 2021 12:57 pm America/New_York

Yes, it's as follows:

/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906001644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906011644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906021644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906031644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906041644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906051644.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906061643.he5
/Users/catherine/Desktop/GOCI_L1/COMS_GOCI_L1B_GA_20110906071643.he5

There's nothing before or after it in the file, only the directories and names of each file.

As for the other 6 files, they are not created. I think the error occurs before it can run the process at all.

OB SeaDAS - xuanyang02
Subject Matter Expert
Subject Matter Expert
Posts: 171
Joined: Tue Feb 09, 2021 5:42 pm America/New_York
Answers: 1

Re: Multilevel Processing Issues with Seadas

by OB SeaDAS - xuanyang02 » Thu Jun 03, 2021 9:15 am America/New_York

Are your GOCI files in usr/Desktop/GOCI_L1/ or /Users/catherine/Desktop/GOCI_L1/?

Can you check by "ls -al /Users/catherine/Desktop/GOCI_L1/"?

catevans
Posts: 13
Joined: Wed Jun 02, 2021 9:47 am America/New_York

Re: Multilevel Processing Issues with Seadas

by catevans » Thu Jun 03, 2021 9:23 am America/New_York

Sorry yes they are in /Users/catherine/Desktop/GOCI_L1/

OB SeaDAS - xuanyang02
Subject Matter Expert
Subject Matter Expert
Posts: 171
Joined: Tue Feb 09, 2021 5:42 pm America/New_York
Answers: 1

Re: Multilevel Processing Issues with Seadas

by OB SeaDAS - xuanyang02 » Thu Jun 03, 2021 9:59 am America/New_York

Can you do "ls -al /Users/catherine/Desktop/GOCI_L1/"?

I do get error like
"Error! File */ifile_list specified the following input files which could not be located:" when the file in the ifile_list does not exsit

catevans
Posts: 13
Joined: Wed Jun 02, 2021 9:47 am America/New_York

Re: Multilevel Processing Issues with Seadas

by catevans » Thu Jun 03, 2021 12:32 pm America/New_York

Yes, it returns:

total 17144440
drwxr-xr-x 40 catherine staff 1280 2 Jun 16:16 .
drwx------+ 52 catherine staff 1664 31 May 15:44 ..
-rw-r--r--@ 1 catherine staff 8196 3 Jun 10:48 .DS_Store
-rw-r--r--@ 1 catherine staff 1013065957 31 May 11:46 COMS_GOCI_L1B_GA_20110906001644.he5
-rw-r--r--@ 1 catherine staff 1013107397 31 May 11:47 COMS_GOCI_L1B_GA_20110906011644.he5
-rw-r--r--@ 1 catherine staff 1013101261 31 May 11:47 COMS_GOCI_L1B_GA_20110906021644.he5
-rw-r--r--@ 1 catherine staff 1013100377 31 May 11:47 COMS_GOCI_L1B_GA_20110906031644.he5
-rw-r--r--@ 1 catherine staff 1013113305 31 May 11:47 COMS_GOCI_L1B_GA_20110906041644.he5
-rw-r--r--@ 1 catherine staff 1013112841 31 May 11:47 COMS_GOCI_L1B_GA_20110906051644.he5
-rw-r--r--@ 1 catherine staff 1013118625 31 May 11:47 COMS_GOCI_L1B_GA_20110906061643.he5
-rw-r--r--@ 1 catherine staff 1013113053 31 May 11:47 COMS_GOCI_L1B_GA_20110906071643.he5
-rw-r--r-- 1 catherine staff 34346876 2 Jun 14:51 G2011249001539.L2_LAC_OC
-rw-r--r-- 1 catherine staff 46886436 2 Jun 15:08 G2011249011539.L2_LAC_OC
-rw-r--r-- 1 catherine staff 47053110 2 Jun 15:29 G2011249021538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 46630291 2 Jun 15:41 G2011249031538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 47127927 2 Jun 15:53 G2011249041538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 47724816 2 Jun 16:07 G2011249051538.L2_LAC_OC
-rw-r--r-- 1 catherine staff 379029188 2 Jun 16:24 G2011249061538.L2_LAC_OC
-rw-r--r--@ 1 catherine staff 14998 2 Jun 16:24 OCSSW_LOG_l2gen.txt
drwxr-xr-x 3 catherine staff 96 26 May 11:19 Output
-rw-r--r-- 1 catherine staff 428 26 May 11:12 Params_for_GOCI
-rw-r--r-- 1 catherine staff 16384 2 Jun 15:42 ancillary_data.db
-rw-r--r-- 1 catherine staff 162 2 Jun 14:33 l2gen-tmpParFile1195492200162734052.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:31 l2gen-tmpParFile1734840618871116778.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:18 l2gen-tmpParFile1977950663505711837.par
-rw-r--r-- 1 catherine staff 162 2 Jun 14:38 l2gen-tmpParFile2095676295842763228.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:17 l2gen-tmpParFile2187744033429230657.par
-rw-r--r-- 1 catherine staff 252 2 Jun 16:09 l2gen-tmpParFile2598132657172012214.par
-rw-r--r-- 1 catherine staff 252 2 Jun 14:40 l2gen-tmpParFile3491154330074317952.par
-rw-r--r-- 1 catherine staff 226 2 Jun 14:39 l2gen-tmpParFile3808563141778987748.par
-rw-r--r-- 1 catherine staff 162 2 Jun 16:08 l2gen-tmpParFile4357575019684759233.par
-rw-r--r-- 1 catherine staff 162 2 Jun 14:39 l2gen-tmpParFile5022778011310873181.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:30 l2gen-tmpParFile5309273649410298377.par
-rw-r--r-- 1 catherine staff 252 2 Jun 14:57 l2gen-tmpParFile5662545860895875444.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:56 l2gen-tmpParFile7213035118431902626.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:30 l2gen-tmpParFile7377932783140023861.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:42 l2gen-tmpParFile7631586698447615786.par
-rw-r--r-- 1 catherine staff 162 2 Jun 15:56 l2gen-tmpParFile7692512815721623244.par
-rw-r--r-- 1 catherine staff 162 2 Jun 14:57 l2gen-tmpParFile8907458223918739389.par
-rw-r--r-- 1 catherine staff 252 2 Jun 15:42 l2gen-tmpParFile986755201560224638.par

catevans
Posts: 13
Joined: Wed Jun 02, 2021 9:47 am America/New_York

Re: Multilevel Processing Issues with Seadas

by catevans » Thu Jun 03, 2021 12:50 pm America/New_York

Sorry I should clarify as well, the L2 files that are in this folder are from running the l2gen tool for each individual file, not for the multilevel_processor tool.

OB SeaDAS - xuanyang02
Subject Matter Expert
Subject Matter Expert
Posts: 171
Joined: Tue Feb 09, 2021 5:42 pm America/New_York
Answers: 1

Re: Multilevel Processing Issues with Seadas

by OB SeaDAS - xuanyang02 » Thu Jun 03, 2021 1:25 pm America/New_York

Can you do "SeaDAS-OCSSW -> SeaDAS/System Info" on SeaDAS GUI?

catevans
Posts: 13
Joined: Wed Jun 02, 2021 9:47 am America/New_York

Re: Multilevel Processing Issues with Seadas

by catevans » Thu Jun 03, 2021 1:40 pm America/New_York

Yes, and this may be the issue since that I see a few warnings? Here they are below:

Main Application Platform:
Application Version: SeaDAS 8.0.0 (Beta)
Installation Directory: /Users/catherine/Desktop/Seadas
Data Directory: /Users/catherine/.seadas8
Configuration: /Users/catherine/Desktop/Seadas/etc/snap.properties
WARNING!! File '/Users/catherine/Desktop/Seadas/etc/snap.properties' does not exist
Configuration2: /Users/catherine/.seadas8/etc/snap.properties
VM Configuration: /Users/catherine/Desktop/Seadas/bin/pconvert.vmoptions
WARNING!! File '/Users/catherine/Desktop/Seadas/bin/pconvert.vmoptions' does not exist
VM Configuration (gpt): /Users/catherine/Desktop/Seadas/bin/gpt.vmoptions
WARNING!! File '/Users/catherine/Desktop/Seadas/bin/gpt.vmoptions' does not exist
Desktop Specification Version: 8.0.1
Engine Specification Version: 8.0.1
JRE: Java(TM) SE Runtime Environment 1.8.0_201-b09
JVM: Java HotSpot(TM) 64-Bit Server VM by Oracle Corporation
Memory: 3641 MiB

OCSSWROOT (Java Env): null

Python3 Directory:
/Library/Frameworks/Python.framework/Versions/3.9/bin/python3

SeaDAS Toolbox:
SeaDAS Toolbox Specification Version: 1.0.0
Configuration: /Users/catherine/.seadas8/etc/seadas.properties
OCSSW Root Directory: /Users/catherine/Desktop/Seadas/ocssw
OCSSW Log Directory: /
OCSSW Location: local
Environment {$OCSSWROOT} (external): null
WARNING!: An environment variable for OCSSWROOT exists which does not match the GUI configuration. The GUI will use '/Users/catherine/Desktop/Seadas/ocssw' as the ocssw root inside the GUI.

-----------------------------------------------

NASA Science Processing (OCSSW):
Environment {$OCSSWROOT}: /Users/catherine/Desktop/Seadas/ocssw
Environment {$OCDATAROOT}: /Users/catherine/Desktop/Seadas/ocssw/share
l2gen version: msl12 9.5.1-V2020.1 (Oct 6 2020 10:49:30)
l2bin version: 6.2.0
l3bin version: 5.13
l3mapgen version: l3mapgen 2.3.0-V2020.1 (Oct 6 2020 10:48:39)
Installed Missions: ['goci']

General System and Software:
Operating system: MacOS 10.14.6
Python version: 2.7.16
Java version: 16.0.1


Is there a specific installation I have to do to get these properties into the SeaDAS application, or should I just redownload it completely?

Post Reply