l2gen fails with 'senz' parameter

Please enter here to ask a question about any NASA Science related topics!
Post Reply
efiliten
Posts: 7
Joined: Thu May 21, 2020 9:11 am America/New_York

l2gen fails with 'senz' parameter

by efiliten » Tue Dec 15, 2020 7:04 am America/New_York

Hi,

I want to process a L1B 250m image and extract Zenith Angle of Observation (view zenith angle). While l2gen runs successfully when creating a 250m resolution LAC product, it fails when 'senz' is also chosen as an output product. What am I missing here?
Running SEADAS 7.5 GUI on an Ubuntu 16.04  machine

Error message (part of it as the complete message exceeds max. text length for a post):

execution exception: java.io.IOException: l2gen failed with exit code 1.
Check log for more details.
Input file /home/efiliten/modis/L1/MYD021KM.A2019306.1125.061.2019307145609.hdf is MODIS Aqua Level-1B HDF-EOS product.
Loading default parameters from /home/efiliten/seadas7.5/ocssw/share/common/msl12_defaults.par
Loading default parameters for MODISA from /home/efiliten/seadas7.5/ocssw/share/modis/msl12_defaults.par
Loading default sub-sensor parameters for MODISA from /home/efiliten/seadas7.5/ocssw/share/modis/aqua/msl12_defaults.par
Loading parameters for suite OC from /home/efiliten/seadas7.5/ocssw/share/modis/msl12_defaults_OC.par
Loading command line parameters

Loading user parameters for MODISA

Loading characteristics for MODISA
Opening sensor information file /home/efiliten/seadas7.5/ocssw/share/modis/aqua/msl12_sensor_info.dat
  Bnd   Lam       Fo    Tau_r     k_oz    k_no2    t_co2   awhite       aw      bbw
    0  412.000  172.912 3.099e-01 1.987e-03 5.814e-19 1.000e+00 1.000e+00 2.030e-02 2.884e-03
    1  443.000  187.622 2.367e-01 3.189e-03 4.985e-19 1.000e+00 1.000e+00 1.110e-02 2.181e-03
[...]
   15 2130.000    9.885 4.286e-04 0.000e+00 0.000e+00 9.696e-01 0.000e+00 2.810e+03 3.465e-06

  Bnd   Lam
   16 3750.000
   17 3959.000
   18 4050.000
   19 6715.000
   20 7325.000
   21 8550.000
   22 11000.000
   23 12000.000

Internal data compression requested at compression level: 4
Opening filter file /home/efiliten/seadas7.5/ocssw/share/modis/msl12_filter.dat
Setting 7 x 5 straylight filter on HILT mask

Filter Kernel
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1

Minimum fill set to 1 pixels

Setting 7 x 5 straylight filter on CLDICE mask

Filter Kernel
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1
1 1 1 1 1 1 1

Minimum fill set to 1 pixels

Reading Thuillier_F0.dat
Processing at 250 meter resolution.
    1000-meter file: /home/efiliten/modis/L1/MYD021KM.A2019306.1125.061.2019307145609.hdf
     500-meter file: /home/efiliten/modis/L1/MYD02HKM.A2019306.1125.061.2019307145609.hdf
     250-meter file: /home/efiliten/modis/L1/MYD02QKM.A2019306.1125.061.2019307145609.hdf

Allocated 9461816 bytes in L1 record.
Allocated 3682880 bytes in L2 record.

Opening: /home/efiliten/modis/L1/A2019306112500_b.L2_LAC_OC

The following products will be included in /home/efiliten/modis/L1/A2019306112500_b.L2_LAC_OC.
0 Kd_490
1 Rrs_412
2 Rrs_443
3 Rrs_469
4 Rrs_488
5 Rrs_531
6 Rrs_547
7 Rrs_555
8 Rrs_645
9 Rrs_667
10 Rrs_678
11 angstrom
12 aot_869
13 chlor_a
14 ipar
15 nflh
16 par
17 pic
18 poc
19 senz
20 senz_412
21 senz_443
22 senz_469
23 senz_488
24 senz_531
25 senz_547
26 senz_555
27 senz_645
28 senz_667
29 senz_678
30 senz_748
31 senz_859
32 senz_869
33 senz_1240
34 senz_1640
35 senz_2130
36 l2_flags

Begin l2gen Version 9.5.0-V2019.3 Processing
Sensor is MODISA
Sensor ID is 7
Sensor has 16 reflective bands
Sensor has 8 emissive bands
Number of along-track detectors per band is 40
Number of input pixels per scan is 5416
Processing pixels 1 to 5416 by 1
Processing scans 1 to 8120 by 1
Ocean processing enabled
Land processing enabled
Atmospheric correction enabled

Begin MSl12 processing at 2020350134652000

Allocated 9461816 bytes in L1 record.
Allocated 9461816 bytes in L1 record.
Allocated 9461816 bytes in L1 record.
Allocated 9461816 bytes in L1 record.
Allocated 9461816 bytes in L1 record.

Loading subframe correction tables:
    /home/efiliten/seadas7.5/ocssw/share/modis/aqua/cal/subframecor_modisa_469.dat
[...]
    /home/efiliten/seadas7.5/ocssw/share/modis/aqua/cal/subframecor_modisa_2130.dat
Subframe destriping corrections enabled.

Loading radiance to brightness temperature from /home/efiliten/seadas7.5/ocssw/share/modis/aqua/cal/bt_modisa.hdf
Loading land mask file from /home/efiliten/seadas7.5/ocssw/share/common/landmask_GMT15ARC.nc
Loading bathymetry mask file from /home/efiliten/seadas7.5/ocssw/share/common/watermask.dat
Loading ice mask file from /home/efiliten/seadas7.5/ocssw/share/common/ice_climatology.hdf
Loaded monthly NSIDC ice climatology HDF file.
Loading elevation file from /home/efiliten/seadas7.5/ocssw/share/common/ETOPO1_ocssw.nc
Loading XCAL rvs and polarization sensitivities from /home/efiliten/seadas7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.40d_412.hdf
[...]
Loading DEM info from /home/efiliten/seadas7.5/ocssw/share/common/ETOPO1_ocssw.nc
Loading climatology file /home/efiliten/seadas7.5/ocssw/share/common/sst_climatology.hdf
Loading SSS reference from Climatology file: /home/efiliten/seadas7.5/ocssw/share/common/sss_climatology_woa2009.hdf

Opening meteorological files.
  met1   = /home/efiliten/seadas7.5/ocssw/share/common/met_climatology_v2014.hdf
  met2   =
  met3   =
  ozone1 = /home/efiliten/seadas7.5/ocssw/share/common/ozone_climatology_v2014.hdf
  ozone2 =
  ozone3 =
  no2    = /home/efiliten/seadas7.5/ocssw/share/common/no2_climatology_v2013.hdf

Opening ozone file /home/efiliten/seadas7.5/ocssw/share/common/ozone_climatology_v2014.hdf

Opening NO2 file /home/efiliten/seadas7.5/ocssw/share/common/no2_climatology_v2013.hdf

Opening NO2 frac file /home/efiliten/seadas7.5/ocssw/share/common/trop_f_no2_200m.hdf

Loading Rayleigh LUT /home/efiliten/seadas7.5/ocssw/share/modis/aqua/rayleigh/rayleigh_modisa_412_iqu.hdf
[...]
Loading polarization file /home/efiliten/seadas7.5/ocssw/share/modis/aqua/cal/polcor_modisa_2010b_2130.hdf

Using  869.0 nm channel for cloud flagging over water.
Using  412.0 nm channel for cloud flagging over land.

Processing scan #     0 (1 of 8120) after      2 seconds

Loading SSES table from /home/efiliten/seadas7.5/ocssw/share/modis/aqua/cal/sst_sses_modisa_v6.5.hdf

Loading SSES table from /home/efiliten/seadas7.5/ocssw/share/modis/aqua/cal/sst4_sses_modisa_v6.5.hdf
Loading SST4 lat band coefficients from /home/efiliten/seadas7.5/ocssw/share/modis/aqua/cal/modis-aqua_sst4_coeffcients_v6.5.nc:
11 -90.00 -40.00  0.696731  1.017848  0.540054  1.982897 -0.003234 -0.000276 -0.000206
11 -40.00 -20.00  0.561891  1.020651  0.570661  2.315591  0.008976 -0.000008 -0.000253
11 -20.00   0.00 -0.058860  1.065085  0.384260  2.747568  0.003616  0.000203 -0.000209
11   0.00  20.00  0.128823  1.063669  0.322972  2.964146  0.011467  0.000147 -0.000220
11  20.00  40.00  0.374961  1.025960  0.607220  2.383230  0.000426  0.000021 -0.000269
11  40.00  60.00  0.604330  1.013355  0.596949  2.091008  0.000490 -0.000028 -0.000255
11  60.00  90.00  1.103000  0.995219  0.484687  1.882289  0.004893 -0.000123 -0.000179
Loading SST lat band coefficients from /home/efiliten/seadas7.5/ocssw/share/modis/aqua/cal/modis-aqua_sst_coeffcients_v6.5.nc:
11 -90.00 -40.00  1.116194  0.943717  0.172922  0.644599  0.000961 -0.000699  0.000138
11 -40.00 -20.00  1.635011  0.941354  0.128879  1.039601  0.006496 -0.002023  0.000102
11 -20.00   0.00  3.715665  0.851082  0.122355  0.937566  0.003682 -0.002705  0.000070
11   0.00  20.00  4.989954  0.806240  0.117141  0.878127  0.017780 -0.002442  0.000071
11  20.00  40.00  1.514339  0.948853  0.127464  1.196107  0.006963 -0.002559  0.000058
11  40.00  60.00  1.475962  0.924335  0.159676  0.299560  0.008381 -0.000982  0.000208
11  60.00  90.00  1.535135  0.871736  0.285057 -1.170576 -0.008408 -0.000453  0.000327
Aerosol selection bands 748 and 869
NIR correction enabled.
Loading aerosol models from /home/efiliten/seadas7.5/ocssw/share/modis/aqua/aerosol/aerosol_modisa
Number of Wavelengths                          17
Number of Solar Zenith Angles                  33
Number of View Zenith Angles                   35
Number of Relative Azimuth Angles              19
Number of Scattering Angles                    75
Number of Diffuse Transmittance Wavelengths    17
Number of Diffuse Transmittance Zenith Angles  33

Limiting aerosol models based on RH.

Using Gordon & Wang aerosol model selection
  and NIR correction with up to 10 iterations
Using bands at 748.0 and 869.0 nm for model selection
Extrapolating from 869.0 nm
80 aerosol models: 8 humidities x 10 size fractions
model 0, rh=30.000000, sd=16, alpha=2.157241, name=r30f95v01
[...]
model 79, rh=95.000000, sd=25, alpha=-0.089512, name=r95f00v01

Loading water-vapor correction coefficients.
chl_hu: using  443.00  547.00  667.00
rh_ndims=5 rh_dimids=4 3 2 1 0
morel f/q file dimensions n_a=13 n_n=17 n_c=6 n_s=6 n_w=7

Reading foq file /home/efiliten/seadas7.5/ocssw/share/common/morel_fq.nc ndims=5 nvars=6 sds_id=5 var=foq

Closing foq file /home/efiliten/seadas7.5/ocssw/share/common/morel_fq.nc

Morel f/Q table from file /home/efiliten/seadas7.5/ocssw/share/common/morel_fq.nc

Applying ocean BRDF including:
    Reflection/refraction for upwelling radiance.
    Reflection/refraction for downwelling radiance.
    Morel f/Q

No Raman scattering correction calculated for Rrs.

Loading climatology file /home/efiliten/seadas7.5/ocssw/share/common/alpha510_climatology.hdf
Loading climatology file /home/efiliten/seadas7.5/ocssw/share/common/taua865_climatology.hdf
Loading aerosol properties for PAR from /home/efiliten/seadas7.5/ocssw/share/modis/modis_aerosol_par.dat.
Loading PIC 2-band algorithm table /home/efiliten/seadas7.5/ocssw/share/common/calcite_table.txt
Assuming PIC table is for 443nm and 555nm.
-E- /home/seadas/ocssw/src/l2gen/prodgen.c, 305: Geometry-dependent view angle information is unavailable for product catalog ID 15.
or, geometry-dependent view angle information was specifically not requested

Tags:

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1164
Joined: Wed Sep 18, 2019 6:15 pm America/New_York

l2gen fails with 'senz' parameter

by OB.DAAC - SeanBailey » Tue Dec 15, 2020 1:24 pm America/New_York

senz will work.  senz_412 (or any wavelength) will not, at least not for MODIS.  There are not many sensors for which a band-dependent geometry is supported in l2gen.

Sean

efiliten
Posts: 7
Joined: Thu May 21, 2020 9:11 am America/New_York

l2gen fails with 'senz' parameter

by efiliten » Wed Dec 16, 2020 5:57 am America/New_York

Hi Sean,

thanks for the response. Do you mean that I should adjust (essentially, diselect) the 'wavelength limiters' when running l2gen? Because this also fails.

Regards,
Liten

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1164
Joined: Wed Sep 18, 2019 6:15 pm America/New_York

l2gen fails with 'senz' parameter

by OB.DAAC - SeanBailey » Wed Dec 16, 2020 8:13 am America/New_York

The wavelength limiters are there to aid the user in selecting wavelength specific data products.  It does work, but the GUI doesn't know if a product is valid for a given sensor.
You can always edit the parameters in the 'Main' tab prior to running.

Sean

efiliten
Posts: 7
Joined: Thu May 21, 2020 9:11 am America/New_York

l2gen fails with 'senz' parameter

by efiliten » Wed Dec 16, 2020 12:52 pm America/New_York

Sean,

l2run run following your tip (specifying geometric parameters senz, ... ). Problem now is, where are the corresponding output rasters? In the output product rasters folder, there are only standard products like chl, pic, poc etc.
Thanks for your help.

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1164
Joined: Wed Sep 18, 2019 6:15 pm America/New_York

l2gen fails with 'senz' parameter

by OB.DAAC - SeanBailey » Wed Dec 16, 2020 1:00 pm America/New_York

If your l2gen parameters included senz in the l2prod option, it will be at the same level as the other products.  Should look something like below.
If you don't see it, perhaps your run didn't actually include it.  The L2 file lists all the parameters used in the run in the metadata.

Sean

Edit: I'm currently fiddling with vicarious calibrations, so had a file handy - yours won't have the vgain folder :wink:

efiliten
Posts: 7
Joined: Thu May 21, 2020 9:11 am America/New_York

l2gen fails with 'senz' parameter

by efiliten » Thu Dec 17, 2020 3:52 am America/New_York

Sean,

What is shown in the picture is what I expect as an output. Checking the log file, l2gen did not run for senz.
I tried to explicitly provide the extra parameters through a .par file and l2gen fails again.
I'm not experienced with seadas so at the moment I'm clueless as to what I'm doing wrong...
Any ideas? :)

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1164
Joined: Wed Sep 18, 2019 6:15 pm America/New_York

l2gen fails with 'senz' parameter

by OB.DAAC - SeanBailey » Thu Dec 17, 2020 8:00 am America/New_York

Can you provide the parameters you set and the exact error l2gen returns?

efiliten
Posts: 7
Joined: Thu May 21, 2020 9:11 am America/New_York

l2gen fails with 'senz' parameter

by efiliten » Mon Dec 21, 2020 4:59 am America/New_York

Hello Sean,

l2gen run successfully giving a 'senz' raster as output. The mistake was at the selection of the 'senz' parameter in Products tab.
I only selected the 'senz' marked by the red arrow (see attached image). After also selecting the child 'senz' it worked.
Thank you for helping!

best,
Liten

[img][/img]

Post Reply