Recent Terra LUTs don't work with older l1bgen code
Posted: Tue Apr 19, 2022 2:10 am America/New_York
Hi,
Our production servers used for near-real-time processing of locally received Aqua and Terra MODIS data still run OCSSW v7.4. Recently I noticed that the Terra LUTs had not been updated for a while (Aqua were up-to-date, but not Terra for some reason), so I ran update_luts.py manually which updated the modist/cal/OPER LUT files to V6.2.2.68 (was V6.1.26.5). This broke l1bgen:
Working back through preceding LUT file sets I find that it seems the problem exists with any V6.2.2.* LUTs. The same problem does not occur with the latest Aqua LUTs (V6.2.1.68 -- I note this is not the same version number, but pretty sure they never have been).
Is this a known issue with newer Terra LUTs and older l1bgen code? What LUT versions are compatible with which OCSSW versions?
kind regards
Simon
Our production servers used for near-real-time processing of locally received Aqua and Terra MODIS data still run OCSSW v7.4. Recently I noticed that the Terra LUTs had not been updated for a while (Aqua were up-to-date, but not Terra for some reason), so I ran update_luts.py manually which updated the modist/cal/OPER LUT files to V6.2.2.68 (was V6.1.26.5). This broke l1bgen:
Code: Select all
$ modis_L1B.py -v T20220412220930_l1a.hdf T20220412220930_geo.hdf -o T20220412220930_l1b_1km.hdf -k T20220412220930_l1b_hkm.hdf -q T20220412220930_l1b_qkm.hdf
LUT directory: /niwa/oper/sat_oper/var/ocssw/modist/cal/OPER
LUT version: 6.2.2.68
Reflective LUT: MOD02_Reflective_LUTs.V6.2.2.68.hdf
Emissive LUT: MOD02_Emissive_LUTs.V6.2.2.68.hdf
QA LUT: MOD02_QA_LUTs.V6.2.2.68.hdf
Processing MODIS L1A file to L1B...
MOD_PR02 version 6.1.12b built on Apr 26 2018, at 05:43:29
/niwa/oper/sat_oper/opt/seadas/seadas-7.4/ocssw/run/bin/linux_64/l1bgen_modist exit status: 1
ERROR: MODIS L1B processing failed.
Please examine the LogStatus and LogUser files for more information.
$ cat LogStatus.T20220412220930_l1b_1km.hdf
****************************************
BEGIN_PGE: Tue Apr 19 05:52:45 2022
MSG_TAG: 11
FILE: <...>/T20220412220930/LogStatus.T20220412220930_l1b_1km.hdf
LOGGING: status message logging enabled
TRACE_LEVEL: tracing disabled
PID_LOGGING: disabled
DISABLED_LEVELS: none
DISABLED_SEEDS: none
DISABLED_CODES: none
THREAD-SAFE MODE: disabled
TOOLKIT_VERSION: SCF TK5.2.18
****************************************
TDLUT_ReadPiecewiseLinearFunction():MODIS_F_NOK:295735304
Either the data type is not float64 or the number of
values are too large (>500) for the attribute
"times" of SDS "m1".
Read_L1B_SDS_LUT():MODIS_F_NOK:295735304
Call to TDLUT_ReadPiecewiseLinearFunction() failed.
Read_LUT_Tables():MODIS_F_NOK:295735304
Call to Read_L1B_SDS_LUT() failed.
File LUN: 700050
File type: Reflective_Lookup_Tables_file
:MODIS_F_NOK:295735304
Fatal error(NOK) running...MOD_PR02. TIME:Tue Apr 19 05:52:45 2022
Operator Actions:
Contact MCST.
Is this a known issue with newer Terra LUTs and older l1bgen code? What LUT versions are compatible with which OCSSW versions?
kind regards
Simon