Unrecoverable error encountered in processing while using multilevel processing

[arnabp893]

Hello,

I am trying to process Modis L1A data to L2 dataset of 2015 and this is my .par file (mlp_aqua_l2gen_swir.par)
[main]
ifile=/Volumes/My_Passport/ifile_text/new2015L1A.txt
odir=/Volumes/My_Passport/extra_modis/2015/SWIR


[level 1b]


[l2gen]
l2prod=Kd_490 Rrs Rrs_1240 Rrs_1640 Rrs_2130 Rrs_748 Rrs_859 Rrs_869 Rrs_vvv aer_model_max aer_model_min aer_model_ratio angstrom aot_869 chlor_a humidity ipar nLw nLw_1240 nLw_1640 nLw_2130 nLw_748 nLw_859 nLw_869 nLw_vvv nflh ozone par pic poc rhos rhos_1240 rhos_1640 rhos_2130 rhos_748 rhos_859 rhos_869 rhos_vvv chl_ocx

suite=OC
# PROCESSING OPTIONS
aer_opt=-1
aer_wave_long=2130
aer_wave_short=1240

# ANCILLARY INPUTS Default = climatology (select 'Get Ancillary' to download ancillary files)

I have data from 2003 to 2022. for first few years this worked swiftly (upto 2009). After that everytime I was using the seadas multilevel_processor on different set of yearly images, I am getting error like this.

(base) 24-f6-77-17-05-4e:~ gulfcarbon$ /Users/gulfcarbon/ocssw/bin/multilevel_processor /Users/gulfcarbon/Downloads/MODIS_L1A/mlp_aqua_l2gen_swir.par
Running geo on file /Volumes/My_Passport/extra_modis/2014/L1A/A2014003191000.L1A_LAC.
Unrecoverable error encountered in processing.
(base) 24-f6-77-17-05-4e:~ gulfcarbon$ /Users/gulfcarbon/ocssw/bin/multilevel_processor /Users/gulfcarbon/Downloads/MODIS_L1A/mlp_aqua_l2gen_swir.par
Running geo on file /Volumes/My_Passport/extra_modis/2010/L1A/A2010006192500.L1A_LAC.
Running level 1b on file /Volumes/My_Passport/extra_modis/2010/L1A/A2010006192500.L1A_LAC.
Unrecoverable error encountered in processing.

I tried different years of file.
1. I tried deleting the files. But did not work.
2. I have enough space in the disk.

strangely when I again tried on the data that is already processed it showed the same error.
(base) 24-f6-77-17-05-4e:~ gulfcarbon$ /Users/gulfcarbon/ocssw/bin/multilevel_processor /Users/gulfcarbon/Downloads/MODIS_L1A/mlp_aqua_l2gen_swir.par
Running geo on file /Volumes/My_Passport/extra_modis/2003/L1A/A2003074192500.L1A_LAC.
Running level 1b on file /Volumes/My_Passport/extra_modis/2003/L1A/A2003074192500.L1A_LAC.

Unrecoverable error encountered in processing.

I cannot understand what went wrong.
Thank you in advanced for any help

[arnabp893]

Any help is appreciated. Thank you

[OB SeaDAS - xuanyang02]

Please run seadas_info and share the result here. Thanks!

[arnabp893]

The system info is here

Last login: Mon Apr 15 11:33:33 on ttys000

The default interactive shell is now zsh.
To update your account to use zsh, please run `chsh -s /bin/zsh`.
For more details, please visit https://support.apple.com/kb/HT208050.
/Users/gulfcarbon/ocssw/bin/seadas_info ; exit;
(base) Euricos-iMac:~ gulfcarbon$ /Users/gulfcarbon/ocssw/bin/seadas_info ; exit;
NASA Science Processing (OCSSW):
Environment {$OCSSWROOT}: /Users/gulfcarbon/ocssw
Environment {$OCDATAROOT}: /Users/gulfcarbon/ocssw/share
l2gen version: msl12 9.6.0-V2022.2 (Nov 28 2022 12:24:20)
l2bin version: 7.0.3
l3bin version: 5.13
l3mapgen version: l3mapgen 2.3.0-V2022.2 (Nov 28 2022 12:25:33)
Installed Missions: ['aqua']

General System and Software:
Operating system: MacOS 10.16
Java version: 16.0.1
Python3 version: 3.9.4
Python3 Path: /usr/local/bin/python3
Env: ASAP_PARMS=/Users/gulfcarbon/ocssw/share/common/nav
CC=gcc
CONDA_DEFAULT_ENV=base
CONDA_EXE=/opt/anaconda3/bin/conda
CONDA_PREFIX=/opt/anaconda3
CONDA_PROMPT_MODIFIER=(base)
CONDA_PYTHON_EXE=/opt/anaconda3/bin/python
CONDA_SHLVL=1
CXX=g++
ELEMENTS=/Users/gulfcarbon/ocssw/var/seawifs
EOS_LIB_PREFIX=macintel64
FC=gfortran
GCC_TUNE=
HDFEOS_LIB=/Users/gulfcarbon/ocssw/opt/EOS/lib/macintel64
HOME=/Users/gulfcarbon
HOMEBREW_CELLAR=/usr/local/Cellar
HOMEBREW_PREFIX=/usr/local
HOMEBREW_REPOSITORY=/usr/local/Homebrew
HRPT_STATION_IDENTIFICATION_FILE=/Users/gulfcarbon/ocssw/share/seawifs/station/station_id.dat
INFOPATH=/usr/local/share/info:
L2GEN_ANC=/Users/gulfcarbon/ocssw/var/anc
LANG=en_US.UTF-8
LIB3_BIN=/Users/gulfcarbon/ocssw/opt/bin
LIB3_CHECK=0
LIB3_DIR=/Users/gulfcarbon/ocssw/opt
LIB3_INC=/Users/gulfcarbon/ocssw/opt/include
LIB3_LIB=/Users/gulfcarbon/ocssw/opt/lib
LOGNAME=gulfcarbon
LaunchInstanceID=3A4E1730-14E9-4545-9480-B4EB955BE571
MANPATH=/usr/local/share/man:
NAVCTL=/Users/gulfcarbon/ocssw/share/seawifs/nav
NAVQC=/Users/gulfcarbon/ocssw/share/seawifs/nav
OCDATAROOT=/Users/gulfcarbon/ocssw/share
OCSSWROOT=/Users/gulfcarbon/ocssw
OCSSW_ARCH=macosx_intel
OCSSW_BIN=/Users/gulfcarbon/ocssw/bin
OCSSW_DEBUG=0
OCTS_REGISTRATION_TABLES=/Users/gulfcarbon/ocssw/share/octs/nav
OCVARROOT=/Users/gulfcarbon/ocssw/var
ORBCTL=/Users/gulfcarbon/ocssw/share/seawifs/nav
PATH=/usr/local/bin:/usr/local/sbin:/Users/gulfcarbon/bin:/opt/anaconda3/bin:/opt/anaconda3/condabin:/Library/Frameworks/Python.framework/Versions/3.9/bin:/Users/gulfcarbon/ocssw/opt/bin:/Users/gulfcarbon/ocssw/bin:/usr/local/bin:/System/Cryptexes/App/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin
PGSINC=/Users/gulfcarbon/ocssw/opt/EOS/include
PGSLIB=/Users/gulfcarbon/ocssw/opt/EOS/lib/macintel64
PROJ_LIB=/Users/gulfcarbon/ocssw/opt/share/proj
PWD=/Users/gulfcarbon
SECURITYSESSIONID=186a3
SHELL=/bin/bash
SHLVL=2
SSH_AUTH_SOCK=/private/tmp/com.apple.launchd.8zKEdXj7nT/Listeners
SWFTBL=/Users/gulfcarbon/ocssw/share/seawifs/qc
SWTBL=/Users/gulfcarbon/ocssw/share/seawifs
TERM=xterm-256color
TERM_PROGRAM=Apple_Terminal
TERM_PROGRAM_VERSION=447
TERM_SESSION_ID=B2738BA1-6752-4C43-9041-3DAD404E74FB
TMPDIR=/var/folders/gl/fqyzcg2n5dj7f_8cbw11_y7r0000gp/T/
USER=gulfcarbon
XPC_FLAGS=0x0
XPC_SERVICE_NAME=0
_=/usr/bin/env
_CE_CONDA=
_CE_M=
__CFBundleIdentifier=com.apple.Terminal
__CF_USER_TEXT_ENCODING=0x1F6:0x0:0x0
logout

Saving session...
...copying shared history...
...saving history...truncating history files...
...completed.
Deleting expired sessions...none found.

[Process completed]

I also enable the debug in mpl and found this
base) Euricos-iMac:~ gulfcarbon$ /Users/gulfcarbon/ocssw/bin/multilevel_processor /Users/gulfcarbon/Downloads/MODIS_L1A/mlp_aqua_l2gen_swir.par
Running geo on file /Volumes/My_Passport/extra_modis/2015/L1A/A2015049185500.L1A_LAC.
in run_nonbatch_processor, output_file = /Volumes/My_Passport/extra_modis/2015/SWIR/AQUA_MODIS.20150218T185500.GEO.hdf
Entering execute_command, cfg_data.verbose = False
Running level 1b on file /Volumes/My_Passport/extra_modis/2015/L1A/A2015049185500.L1A_LAC.
in run_nonbatch_processor, output_file = /Volumes/My_Passport/extra_modis/2015/SWIR/AQUA_MODIS.20150218T185500.L1B.hdf
Entering execute_command, cfg_data.verbose = False
Error! The multilevel_processor program encountered an unrecoverable <class 'AttributeError, 'Processor' object has no attribute 'instrument', at line 2381 of multilevel_processor!

[arnabp893]

I tried the same process in a different system and got the same error. Both of them has 8.3.0 version of Seadas. has it something to do with the version?

[OB SeaDAS - xuanyang02]

multilevel processing does change with OCSSW tags. We are trying to replicate the error, will get back to you...

[OB SeaDAS - xuanyang02]

I ran multilevel_processor with the files on my Mac, and it seems to work. I am using OCSSW T2024.16. You could try V2023.3. Please let us know if it works for your 2015 files.

See this post --

viewtopic.php?p=16897&hilit=multilevel#p16895

[arnabp893]

I tried with T2024.16 with version SeaDAS 9.0.0
I installed the version and set the OCSSWROOT and environment as
export OCSSWROOT=/Users/gulfcarbon2/SeaDAS/ocssw
source $/Users/gulfcarbon/SeaDAS/ocssw/OCSSW_bash.env

I ran the processing the output is
(base) Euricos-iMac:~ gulfcarbon$ /Users/gulfcarbon/SeaDAS/ocssw/bin/multilevel_processor par=/Users/gulfcarbon/Downloads/MODIS_L1A/mlp_aqua_l2gen_swir.par
/Users/gulfcarbon2/SeaDAS/ocssw/opt/bin/hdp is not executable.
Warning: Unable to determine a type for file /Volumes/My_Passport/extra_modis/2015/L1A/A2015049185500.L1A_LAC. It will not be processed.
/Users/gulfcarbon2/SeaDAS/ocssw/opt/bin/hdp is not executable.

THe obpg _file_type is also showing unknown. This error got resolved earlier by setting the environment.