Earthdata Forum

Welcome to the Earthdata Forum! Here, the scientific user community and subject matter experts from NASA Distributed Active Archive Centers (DAACs), and other contributors, discuss research needs, data, and data applications.
https://forum.earthdata.nasa.gov/

modis_L1B stopped outputting HKM and QKM files

https://forum.earthdata.nasa.gov/viewtopic.php?t=4525

Page 1 of 1

modis_L1B stopped outputting HKM and QKM files

Posted: Thu Jul 27, 2023 12:50 pm America/New_York
by daurin
Recently, running modis_L1B would output LAC, HKM, and QKM files by default (i.e., when the -o, -k, -q options were not used). Now, only the LAC L1B is produced, and furthermore, no HKM or QKM files are produced even when using the -k and -q options.

Running from a directory with an L1A_LAC and GEO file:

Code: Select all

daurin@MacBook-Pro:/Volumes/Megalodon/MODIS/Chesapeake_Bay$ ll
total 552640
drwxr-xr-x   6 daurin  staff   204B Jul 27 12:38 ./
drwxrwxrwx  14 daurin  staff   476B Apr 18 22:09 ../
-rw-r--r--   1 daurin  staff    89M Jul 27 12:38 A2021121070000.GEO
-rw-r--r--   1 daurin  staff   181M Jul 27 12:38 A2021121070000.L1A_LAC
drwxr-xr-x  91 daurin  staff   3.0K Jul 27 12:22 L1/
drwxr-xr-x  25 daurin  staff   850B Apr 17 18:58 L2/
I test modis_L1B with output options for 1KM, HKM, and QKM:

Code: Select all

daurin@MacBook-Pro:/Volumes/Megalodon/MODIS/Chesapeake_Bay$ modis_L1B -v -o test.L1B_LAC -k test.L1B_HKM -q test.L1B_QKM A2021121070000.L1A_LAC A2021121070000.GEO

LUT directory: /Users/daurin/Applications/ocssw/var/modisa/cal/OPER
LUT version: 6.2.1.86_OC_v2.11
Reflective LUT: MYD02_Reflective_LUTs.V6.2.1.86_OC_v2.11.hdf
Emissive LUT: MYD02_Emissive_LUTs.V6.2.1.86_OC_v2.11.hdf
QA LUT: MYD02_QA_LUTs.V6.2.1.86_OC_v2.11.hdf

Processing MODIS L1A file to L1B...
MODIS Aqua L1B version 6.2.1_obpg, built Apr  4 2023 11:27:06
scan: 0 out of 203 Thu Jul 27 12:40:02 2023
scan: 10 out of 203 Thu Jul 27 12:40:05 2023
scan: 20 out of 203 Thu Jul 27 12:40:05 2023
scan: 30 out of 203 Thu Jul 27 12:40:05 2023
scan: 40 out of 203 Thu Jul 27 12:40:05 2023
scan: 50 out of 203 Thu Jul 27 12:40:05 2023
scan: 60 out of 203 Thu Jul 27 12:40:06 2023
scan: 70 out of 203 Thu Jul 27 12:40:06 2023
scan: 80 out of 203 Thu Jul 27 12:40:06 2023
scan: 90 out of 203 Thu Jul 27 12:40:06 2023
scan: 100 out of 203 Thu Jul 27 12:40:06 2023
scan: 110 out of 203 Thu Jul 27 12:40:06 2023
scan: 120 out of 203 Thu Jul 27 12:40:06 2023
scan: 130 out of 203 Thu Jul 27 12:40:06 2023
scan: 140 out of 203 Thu Jul 27 12:40:07 2023
scan: 150 out of 203 Thu Jul 27 12:40:07 2023
scan: 160 out of 203 Thu Jul 27 12:40:07 2023
scan: 170 out of 203 Thu Jul 27 12:40:07 2023
scan: 180 out of 203 Thu Jul 27 12:40:07 2023
scan: 190 out of 203 Thu Jul 27 12:40:07 2023
scan: 200 out of 203 Thu Jul 27 12:40:07 2023
/Users/daurin/Applications/ocssw/bin/l1bgen_modisa exit status: 0
MODIS L1B processing complete.
...But find that only the 1KM LAC was produced:

Code: Select all

daurin@MacBook-Pro:/Volumes/Megalodon/MODIS/Chesapeake_Bay$ lr
total 831424
drwxr-xr-x  25 daurin  staff        850 Apr 17 18:58 L2
drwxr-xr-x  91 daurin  staff       3094 Jul 27 12:22 L1
-rw-r--r--   1 daurin  staff   93119081 Jul 27 12:38 A2021121070000.GEO
-rw-r--r--   1 daurin  staff  189807195 Jul 27 12:38 A2021121070000.L1A_LAC
-rw-r--r--   1 daurin  staff  142719173 Jul 27 12:40 test.L1B_LAC
Testing again with no/default output options

Code: Select all

daurin@MacBook-Pro:/Volumes/Megalodon/MODIS/Chesapeake_Bay$ modis_L1B -v A2021121070000.L1A_LAC A2021121070000.GEo

LUT directory: /Users/daurin/Applications/ocssw/var/modisa/cal/OPER
LUT version: 6.2.1.86_OC_v2.11
Reflective LUT: MYD02_Reflective_LUTs.V6.2.1.86_OC_v2.11.hdf
Emissive LUT: MYD02_Emissive_LUTs.V6.2.1.86_OC_v2.11.hdf
QA LUT: MYD02_QA_LUTs.V6.2.1.86_OC_v2.11.hdf

Processing MODIS L1A file to L1B...
MODIS Aqua L1B version 6.2.1_obpg, built Apr  4 2023 11:27:06
scan: 0 out of 203 Thu Jul 27 12:40:48 2023
scan: 10 out of 203 Thu Jul 27 12:40:51 2023
scan: 20 out of 203 Thu Jul 27 12:40:51 2023
scan: 30 out of 203 Thu Jul 27 12:40:51 2023
scan: 40 out of 203 Thu Jul 27 12:40:51 2023
scan: 50 out of 203 Thu Jul 27 12:40:51 2023
scan: 60 out of 203 Thu Jul 27 12:40:51 2023
scan: 70 out of 203 Thu Jul 27 12:40:51 2023
scan: 80 out of 203 Thu Jul 27 12:40:51 2023
scan: 90 out of 203 Thu Jul 27 12:40:52 2023
scan: 100 out of 203 Thu Jul 27 12:40:52 2023
scan: 110 out of 203 Thu Jul 27 12:40:52 2023
scan: 120 out of 203 Thu Jul 27 12:40:52 2023
scan: 130 out of 203 Thu Jul 27 12:40:52 2023
scan: 140 out of 203 Thu Jul 27 12:40:52 2023
scan: 150 out of 203 Thu Jul 27 12:40:52 2023
scan: 160 out of 203 Thu Jul 27 12:40:52 2023
scan: 170 out of 203 Thu Jul 27 12:40:53 2023
scan: 180 out of 203 Thu Jul 27 12:40:53 2023
scan: 190 out of 203 Thu Jul 27 12:40:53 2023
scan: 200 out of 203 Thu Jul 27 12:40:53 2023
/Users/daurin/Applications/ocssw/bin/l1bgen_modisa exit status: 0
MODIS L1B processing complete.
Similarly only produces the 1KM LAC, this time renamed to the new default convention:

Code: Select all

daurin@MacBook-Pro:/Volumes/Megalodon/MODIS/Chesapeake_Bay$ lr
total 1110208
drwxr-xr-x  25 daurin  staff        850 Apr 17 18:58 L2
drwxr-xr-x  91 daurin  staff       3094 Jul 27 12:22 L1
-rw-r--r--   1 daurin  staff   93119081 Jul 27 12:38 A2021121070000.GEO
-rw-r--r--   1 daurin  staff  189807195 Jul 27 12:38 A2021121070000.L1A_LAC
-rw-r--r--   1 daurin  staff  142719173 Jul 27 12:40 test.L1B_LAC
-rw-r--r--   1 daurin  staff  142719225 Jul 27 12:40 AQUA_MODIS.20210501T070000.L1B.hdf
Here is the output from seadas_info (note the fortran library issues on >=L2 processors, which I will be posting separately later):

Code: Select all

NASA Science Processing (OCSSW):
OCSSWROOT=/Users/daurin/Applications/ocssw
OCDATAROOT=/Users/daurin/Applications/ocssw/share
l2gen version: Reason: tried: '/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/usr/local/lib/libgfortran.5.dylib' (no such file), '/usr/lib/libgfortran.5.dylib' (no such file, not in dyld cache)
l2bin version: Reason: tried: '/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/usr/local/lib/libgfortran.5.dylib' (no such file), '/usr/lib/libgfortran.5.dylib' (no such file, not in dyld cache)
l3bin version: Reason: tried: '/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/usr/local/lib/libgfortran.5.dylib' (no such file), '/usr/lib/libgfortran.5.dylib' (no such file, not in dyld cache)
l3mapgen version: Reason: tried: '/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/usr/local/opt/gcc@9/lib/gcc/9/libgfortran.5.dylib' (no such file), '/usr/local/lib/libgfortran.5.dylib' (no such file), '/usr/lib/libgfortran.5.dylib' (no such file, not in dyld cache)
Installed Missions: ['hawkeye', 'aqua', 'terra']

General System and Software:
Operating system: MacOS 13.4.1
Java version: 
Python3 version: 3.8.16
Python3 Path: /Users/daurin/anaconda3/bin/python3
Env:
   CC=gcc
   CXX=g++
   ELEMENTS=/Users/daurin/Applications/ocssw/var/seawifs
   EOS_LIB_PREFIX=macintel64
   FC=gfortran
   GCC_TUNE=
   HDFEOS_LIB=/Users/daurin/Applications/ocssw/opt/EOS/lib/macintel64
   HRPT_STATION_IDENTIFICATION_FILE=/Users/daurin/Applications/ocssw/share/seawifs/station/station_id.dat
   L2GEN_ANC=/Users/daurin/Applications/ocssw/var/anc
   LIB3_BIN=/Users/daurin/Applications/ocssw/opt/bin
   LIB3_CHECK=0
   LIB3_DIR=/Users/daurin/Applications/ocssw/opt
   LIB3_INC=/Users/daurin/Applications/ocssw/opt/include
   LIB3_LIB=/Users/daurin/Applications/ocssw/opt/lib
   NAVCTL=/Users/daurin/Applications/ocssw/share/seawifs/nav
   NAVQC=/Users/daurin/Applications/ocssw/share/seawifs/nav
   OCSSW_ARCH=macosx_intel
   OCSSW_BIN=/Users/daurin/Applications/ocssw/bin
   OCSSW_DEBUG=0
   OCSSW_MODIS=1
   OCTS_REGISTRATION_TABLES=/Users/daurin/Applications/ocssw/share/octs/nav
   OCVARROOT=/Users/daurin/Applications/ocssw/var
   ORBCTL=/Users/daurin/Applications/ocssw/share/seawifs/nav
   PGSINC=/Users/daurin/Applications/ocssw/opt/EOS/include
   PGSLIB=/Users/daurin/Applications/ocssw/opt/EOS/lib/macintel64
   PROJ_DATA=/Users/daurin/Applications/ocssw/opt/share/proj
   PROJ_LIB=/Users/daurin/Applications/ocssw/opt/share/proj
   SWFTBL=/Users/daurin/Applications/ocssw/share/seawifs/qc
   SWTBL=/Users/daurin/Applications/ocssw/share/seawifs

Re: modis_L1B stopped outputting HKM and QKM files

Posted: Thu Jul 27, 2023 5:01 pm America/New_York
by OB.DAACx - SeanBailey
0700 UTC for the Chesapeake Bay is at night....so the granule doesn't have valid reflective solar band data and the HKM and QKM files (which only have reflective solar bands) are not output.

Sean

Re: modis_L1B stopped outputting HKM and QKM files

Posted: Thu Jul 27, 2023 5:39 pm America/New_York
by daurin
Aha! Solved. That makes a lot of sense. My batch downloader is clearly grabbing files I don't want. Thanks, Sean
All times are UTC-04:00
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited