l2bin - unsupported datatype output

[cliffordoo]

Hi Everyone,

I am receiving some unusual output when processing from L2 to L3 using L2bin. I am interested in obtaining the products Rrs_645, Rrs_859, as well as nLw for both of these bands. I have tried processing from both the GUI and a batch script. The netCDF output from the GUI processing is below. I tried importing the Rrs_645 variable but the output is "not a recognized NetCDF datatype." In the output below "unsupported datatype" appears in the variable list. I was expecting a matrix that could be mapped with l3mapgen.

Thanks for your help.

Andy


>> ncdisp("AQUA_MODIS.2002070420020704.L3b.DAY.nc")
Source:
/Users/andy/Documents/MATLAB/Anushka/AQUA_MODIS.2002070420020704.L3b.DAY.nc
Format:
netcdf4
Global Attributes:
product_name = '/home/andrew/modis/process/AQUA_MODIS.2002070420020704.L3b.DAY.nc'
title = 'MODIS Level-3 Binned Data'
instrument = 'MODIS'
platform = 'Aqua'
temporal_range = '1-hour'
start_orbit_number = 887
end_orbit_number = 887
date_created = '2023-06-27T03:02:48.000Z'
processing_version = 'unspecified'
history = 'l2bin par=/home/andrew/modis/process/l2bin-tmpParFile247895494820978589.par'
time_coverage_start = '2002-07-04T04:08:46.000Z'
time_coverage_end = '2002-07-04T04:09:28.000Z'
northernmost_latitude = -39.2279
southernmost_latitude = -41.5638
easternmost_longitude = 149.0607
westernmost_longitude = 143.5967
geospatial_lat_max = -39.2279
geospatial_lat_min = -41.5638
geospatial_lon_max = 149.0607
geospatial_lon_min = 143.5967
geospatial_lat_units = 'degrees_north'
geospatial_lon_units = 'degrees_east'
geospatial_lon_resolution = 0.0026042
geospatial_lat_resolution = 0.0026042
spatialResolution = '288 m'
data_bins = 159167
percent_data_bins = 0.0026166
units = 'Rrs_645:sr^-1'
binning_scheme = 'Integerized Sinusoidal Grid'
project = 'Ocean Biology Processing Group (NASA/GSFC/OBPG)'
institution = 'NASA Goddard Space Flight Center, Ocean Ecology Laboratory, Ocean Biology Processing Group'
standard_name_vocabulary = 'CF Standard Name Table v36'
Conventions = 'CF-1.6 ACDD-1.3'
naming_authority = 'gov.nasa.gsfc.sci.oceandata'
id = '/home/andrew/modis/process/AQUA_MODIS.2002070420020704.L3b.DAY.nc/L3//home/andrew/modis/process/AQUA_MODIS.2002070420020704.L3b.DAY.nc'
license = 'https://science.nasa.gov/earth-science/earth-science-data/data-information-policy/'
creator_name = 'NASA/GSFC/OBPG'
publisher_name = 'NASA/GSFC/OBPG'
creator_email = 'data@oceancolor.gsfc.nasa.gov'
publisher_email = 'data@oceancolor.gsfc.nasa.gov'
creator_url = 'https://oceandata.sci.gsfc.nasa.gov'
publisher_url = 'https://oceandata.sci.gsfc.nasa.gov'
processing_level = 'L3 Binned'
cdm_data_type = 'point'
Groups:
/level-3_binned_data/
Dimensions:
binListDim = 159167 (UNLIMITED)
binDataDim = 159167 (UNLIMITED)
binIndexDim = 69120 (UNLIMITED)
Variables:
BinList
Size: 159167x1
Dimensions: binListDim
Datatype: UNSUPPORTED DATATYPE
Rrs_645
Size: 159167x1
Dimensions: binDataDim
Datatype: UNSUPPORTED DATATYPE
BinIndex
Size: 69120x1
Dimensions: binIndexDim
Datatype: UNSUPPORTED DATATYPE

/processing_control/
Attributes:
software_name = 'l2bin'
software_version = '7.0.3'
source = 'A2002185040500.L2'
l2_flag_names = 'ATMFAIL,LAND,HIGLINT,HISATZEN,STRAYLIGHT,CLDICE,HISOLZEN'
Groups:
/processing_control/input_parameters/
Attributes:
infile = '/home/andrew/modis/process/A2002185040500.L2'
ofile = '/home/andrew/modis/process/AQUA_MODIS.2002070420020704.L3b.DAY.nc'
fileuse = ''
sday = '1970001'
eday = '2038018'
latnorth = '90.000000'
latsouth = '-90.000000'
loneast = '0.000000'
lonwest = '0.000000'
resolve = 'Q'
rowgroup = '270'
flaguse = 'ATMFAIL,LAND,HIGLINT,HISATZEN,STRAYLIGHT,CLDICE,HISOLZEN'
l3bprod = 'Rrs_645'
output_wavelengths = 'ALL'
prodtype = 'day'
pversion = 'unspecified'
suite = ''
night = '0'
verbose = '1'
minobs = '0'
delta_crossing_time = '0.000000'
deflate = '5'
qual_prod = ''
composite_prod = ''
composite_scheme = ''
qual_max = '2'

[OB SeaDAS - xuanyang02]

I downloaded A2002185040500.L1A_LAC and AQUA_MODIS.20020704T040500.GEO.hdf,
did modis_L1B, l2gen, l2bin, and l3mapgen. I was able to create
AQUA_MODIS.2002070420020704.L3m_Rrs_645.DAY.nc
AQUA_MODIS.2002070420020704.L3m_Rrs_859.DAY.nc
AQUA_MODIS.2002070420020704.L3m_nLw_645.DAY.nc
AQUA_MODIS.2002070420020704.L3m_nLw_859.DAY.nc

[OB SeaDAS - xuanyang02]

When you get

Variables:
BinList
Size: 159167x1
Dimensions: binListDim
Datatype: UNSUPPORTED DATATYPE
Rrs_645
Size: 159167x1
Dimensions: binDataDim
Datatype: UNSUPPORTED DATATYPE
BinIndex
Size: 69120x1
Dimensions: binIndexDim
Datatype: UNSUPPORTED DATATYPE

with ncdisp

It just means the datatype is not supported by NetCDF. It probably does not prevent you from doing l3mapgen on the file AQUA_MODIS.2002070420020704.L3b.DAY.nc

[cliffordoo]

Thanks for the response. Works in the GUI, but I am trying to batch process.
Here is the script...

##############################
for l2filename in *.L2

do
# define file directories and create file list
datadir="/home/andrew/modis/process/"
outdir="/home/andrew/modis/process/"
flags=ATMFAIL,LAND,HIGLINT,STRAYLIGHT,CLDICE,HISOLZEN,HISATZEN

rootfilename=`echo $l2filename | awk '{print substr($0,1,14)}'`
outL2filename=`echo $rootfilename".L3"`
$OCSSWROOT/bin/l2bin infile=$l2filename ofile=$outL2filename resolve='Q' flaguse=$flags l3bprod='ALL'

done

for l3filename in *.L3

do

# define file directories and create file list
datadir="/home/andrew/modis/process/"
outdir="/home/andrew/modis/process/"
# Desired products: chlor_a sst par l2_flags qual_sst,Rrs_645,Rrs_859,nLw_645,nLw_859,l2_flags
prods=Rrs_645,Rrs_859,nLw_645,nLw_859,l2_flags

rootfilename=`echo $l3filename | awk '{print substr($0,1,14)}'`
outl3filename=`echo $rootfilename".L3M"`
$OCSSWROOT/bin/l3mapgen ifile=$l3filename ofile=$outl3filename product=$prods resolution=250m north=-3$

done


exit 0
########################

When I process with l3mapgen, I get the following error...

Loading default parameters from /home/andrew/SeaDAS/ocssw/share/modis/l3mapgen_defaults.par
Product: l2_flags not found.-E- Could not find product="Rrs_645,Rrs_859,nLw_645,nLw_859,l2_flags" in file="A2002185040500.L3".

It seems to be unable to find the products that I am interested in. I have tried changing l3mapgen_defaults.par to include those products, but the same error results. This routine works just fine for other products, but not the Rrs at 250km.

Is there a step that I am missing?

Thanks again,

Andy

[OB SeaDAS - xuanyang02]

I don't think you can bin l2_flags. See the explanation here -- viewtopic.php?p=13793&hilit=l2bin#p13824

If you take l2_flags out, and have
prods=Rrs_645,Rrs_859,nLw_645,nLw_859

things should work

[cliffordoo]

All good. Thank you!