All realtime processing failing
Posted: Wed Dec 02, 2020 10:13 am America/New_York
I have 286 passes that have MODIS failures since doy 336 in all my subscription area. VIIRS is unaffected using the same software.
It seems that the L1B files produced have errors?
This is what I am seeing:
$ ll -ltrh
total 379M
-rw-rw-r-- 1 bmurch usfuser 379M Dec 2 09:45 MOD00.P2020336.1755_1.PDS
-rw-r--r-- 1 bmurch usfuser 4.0K Dec 2 09:53 ancillary_data.db
$ modis_L1A.py ./MOD00.P2020336.1755_1.PDS -o ./MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC --startnudge=0 --stopnudge=10
MODIS L1A version 6.0.6, built Aug 16 2019 12:46:26
scan: 0 out of 201 Wed Dec 2 10:03:07 2020
...
scan: 190 out of 201 Wed Dec 2 10:03:15 2020
[bmurch@optics0 P2020336.1755]$ ll -ltrh
total 908M
-rw-rw-r-- 1 bmurch usfuser 379M Dec 2 09:45 MOD00.P2020336.1755_1.PDS
-rw-r--r-- 1 bmurch usfuser 4.0K Dec 2 09:53 ancillary_data.db
-rw-rw-r-- 1 bmurch usfuser 530M Dec 2 10:03 MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC
[bmurch@optics0 P2020336.1755]$ modis_GEO.py MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC -o MOD00.P2020337.1755.BIGBEND_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
MODIS GEO version 6.1.0, built Aug 16 2019 12:46:24
scan: 0 out of 196 Wed Dec 2 10:03:41 2020
...
scan: 190 out of 196 Wed Dec 2 10:03:42 2020
Percent valid data (0.00) is less than threshold (95.00)
ERROR: MODIS geolocation processing failed.
There are error files created:
$ ll -ltrh
total 911M
-rw-rw-r-- 1 bmurch usfuser 379M Dec 2 09:45 MOD00.P2020336.1755_1.PDS
-rw-r--r-- 1 bmurch usfuser 4.0K Dec 2 10:03 ancillary_data.db
-rw-rw-r-- 1 bmurch usfuser 23K Dec 2 10:03 MOD00.P2020337.1755.BIGBEND_FULL.GEO.pcf
-rw-rw-r-- 1 bmurch usfuser 1.2K Dec 2 10:03 LogReport.MOD00.P2020337.1755.BIGBEND_FULL.GEO
-rw-rw-r-- 1 bmurch usfuser 2.2M Dec 2 10:03 MOD00.P2020337.1755.BIGBEND_FULL.GEO
-rw-rw-r-- 1 bmurch usfuser 530M Dec 2 10:03 MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC
-rw-rw-r-- 1 bmurch usfuser 266K Dec 2 10:03 LogStatus.MOD00.P2020337.1755.BIGBEND_FULL.GEO
-rw-rw-r-- 1 bmurch usfuser 1.2K Dec 2 10:03 LogUser.MOD00.P2020337.1755.BIGBEND_FULL.GEO
See attached files but ... the all seem to have this
$ cat LogReport.MOD00.P2020337.1755.BIGBEND_FULL.GEO
FILE: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020336.1755/LogReport.MOD00.P2020337.1755.BIGBEND_FULL.GEO
LOGGING: status message logging enabled
TRACE_LEVEL: tracing disabled
PID_LOGGING: disabled
DISABLED_LEVELS: none
DISABLED_SEEDS: none
DISABLED_CODES: PGSCSC_W_PREDICTED_UT1 PGSDEM_M_FILLVALUE_INCLUDED
THREAD-SAFE MODE: disabled
TOOLKIT_VERSION: SCF TK5.2.19
****************************************
Wed Dec 2 10:03:42 2020
Input file name: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020336.1755/MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC
Output file name: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020336.1755/MOD00.P2020337.1755.BIGBEND_FULL.GEO
Local Granule ID: MYD01.A2020336.1755.061.2020337150315.hdf
scans: 196
pixels: 0
missing: 0
out of bounds: 0
Cumulated gflags: 0, 0, 0, 0, 0, 0, 0, 0
Bounding coordinates
east: 3.141593
west: -3.141593
north: -1.570796
south: 1.570796
==========================================================
AND:
$ cat LogReport.MOD00.P2020337.1155.ANGOLA_FULL.GEO
****************************************
BEGIN_PGE: Wed Dec 2 10:09:16 2020
MSG_TAG: 11
FILE: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020337.1155/LogReport.MOD00.P2020337.1155.ANGOLA_FULL.GEO
LOGGING: status message logging enabled
TRACE_LEVEL: tracing disabled
PID_LOGGING: disabled
DISABLED_LEVELS: none
DISABLED_SEEDS: none
DISABLED_CODES: PGSCSC_W_PREDICTED_UT1 PGSDEM_M_FILLVALUE_INCLUDED
THREAD-SAFE MODE: disabled
TOOLKIT_VERSION: SCF TK5.2.19
****************************************
Wed Dec 2 10:09:18 2020
Input file name: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020337.1155/MOD00.P2020337.1155.ANGOLA_FULL.L1A_LAC
Output file name: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020337.1155/MOD00.P2020337.1155.ANGOLA_FULL.GEO
Local Granule ID: MYD01.A2020337.1155.061.2020337150908.hdf
scans: 196
pixels: 0
missing: 0
out of bounds: 0
Cumulated gflags: 0, 0, 0, 0, 0, 0, 0, 0
Bounding coordinates
east: 3.141593
west: -3.141593
north: -1.570796
south: 1.570796
==========================================================attachment 1
attachment 2
attachment 3
It seems that the L1B files produced have errors?
This is what I am seeing:
$ ll -ltrh
total 379M
-rw-rw-r-- 1 bmurch usfuser 379M Dec 2 09:45 MOD00.P2020336.1755_1.PDS
-rw-r--r-- 1 bmurch usfuser 4.0K Dec 2 09:53 ancillary_data.db
$ modis_L1A.py ./MOD00.P2020336.1755_1.PDS -o ./MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC --startnudge=0 --stopnudge=10
MODIS L1A version 6.0.6, built Aug 16 2019 12:46:26
scan: 0 out of 201 Wed Dec 2 10:03:07 2020
...
scan: 190 out of 201 Wed Dec 2 10:03:15 2020
[bmurch@optics0 P2020336.1755]$ ll -ltrh
total 908M
-rw-rw-r-- 1 bmurch usfuser 379M Dec 2 09:45 MOD00.P2020336.1755_1.PDS
-rw-r--r-- 1 bmurch usfuser 4.0K Dec 2 09:53 ancillary_data.db
-rw-rw-r-- 1 bmurch usfuser 530M Dec 2 10:03 MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC
[bmurch@optics0 P2020336.1755]$ modis_GEO.py MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC -o MOD00.P2020337.1755.BIGBEND_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
MODIS GEO version 6.1.0, built Aug 16 2019 12:46:24
scan: 0 out of 196 Wed Dec 2 10:03:41 2020
...
scan: 190 out of 196 Wed Dec 2 10:03:42 2020
Percent valid data (0.00) is less than threshold (95.00)
ERROR: MODIS geolocation processing failed.
There are error files created:
$ ll -ltrh
total 911M
-rw-rw-r-- 1 bmurch usfuser 379M Dec 2 09:45 MOD00.P2020336.1755_1.PDS
-rw-r--r-- 1 bmurch usfuser 4.0K Dec 2 10:03 ancillary_data.db
-rw-rw-r-- 1 bmurch usfuser 23K Dec 2 10:03 MOD00.P2020337.1755.BIGBEND_FULL.GEO.pcf
-rw-rw-r-- 1 bmurch usfuser 1.2K Dec 2 10:03 LogReport.MOD00.P2020337.1755.BIGBEND_FULL.GEO
-rw-rw-r-- 1 bmurch usfuser 2.2M Dec 2 10:03 MOD00.P2020337.1755.BIGBEND_FULL.GEO
-rw-rw-r-- 1 bmurch usfuser 530M Dec 2 10:03 MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC
-rw-rw-r-- 1 bmurch usfuser 266K Dec 2 10:03 LogStatus.MOD00.P2020337.1755.BIGBEND_FULL.GEO
-rw-rw-r-- 1 bmurch usfuser 1.2K Dec 2 10:03 LogUser.MOD00.P2020337.1755.BIGBEND_FULL.GEO
See attached files but ... the all seem to have this
$ cat LogReport.MOD00.P2020337.1755.BIGBEND_FULL.GEO
FILE: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020336.1755/LogReport.MOD00.P2020337.1755.BIGBEND_FULL.GEO
LOGGING: status message logging enabled
TRACE_LEVEL: tracing disabled
PID_LOGGING: disabled
DISABLED_LEVELS: none
DISABLED_SEEDS: none
DISABLED_CODES: PGSCSC_W_PREDICTED_UT1 PGSDEM_M_FILLVALUE_INCLUDED
THREAD-SAFE MODE: disabled
TOOLKIT_VERSION: SCF TK5.2.19
****************************************
Wed Dec 2 10:03:42 2020
Input file name: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020336.1755/MOD00.P2020336.1755.BIGBEND_FULL.L1A_LAC
Output file name: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020336.1755/MOD00.P2020337.1755.BIGBEND_FULL.GEO
Local Granule ID: MYD01.A2020336.1755.061.2020337150315.hdf
scans: 196
pixels: 0
missing: 0
out of bounds: 0
Cumulated gflags: 0, 0, 0, 0, 0, 0, 0, 0
Bounding coordinates
east: 3.141593
west: -3.141593
north: -1.570796
south: 1.570796
==========================================================
AND:
$ cat LogReport.MOD00.P2020337.1155.ANGOLA_FULL.GEO
****************************************
BEGIN_PGE: Wed Dec 2 10:09:16 2020
MSG_TAG: 11
FILE: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020337.1155/LogReport.MOD00.P2020337.1155.ANGOLA_FULL.GEO
LOGGING: status message logging enabled
TRACE_LEVEL: tracing disabled
PID_LOGGING: disabled
DISABLED_LEVELS: none
DISABLED_SEEDS: none
DISABLED_CODES: PGSCSC_W_PREDICTED_UT1 PGSDEM_M_FILLVALUE_INCLUDED
THREAD-SAFE MODE: disabled
TOOLKIT_VERSION: SCF TK5.2.19
****************************************
Wed Dec 2 10:09:18 2020
Input file name: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020337.1155/MOD00.P2020337.1155.ANGOLA_FULL.L1A_LAC
Output file name: /shares/cms_optics/virtual_ant/S4P/S4P_MODIS_H5/seadas_l1a_geo_extract_h5/failed/P2020337.1155/MOD00.P2020337.1155.ANGOLA_FULL.GEO
Local Granule ID: MYD01.A2020337.1155.061.2020337150908.hdf
scans: 196
pixels: 0
missing: 0
out of bounds: 0
Cumulated gflags: 0, 0, 0, 0, 0, 0, 0, 0
Bounding coordinates
east: 3.141593
west: -3.141593
north: -1.570796
south: 1.570796
==========================================================attachment 1
attachment 2
attachment 3