Serveral failures like this

[oo_processing]

Lo all,

I was processing some recent data (4 different areas) that all rely on the same anc data I believe. They all errored out like this:

Loading radiance to brightness temperature from /optics1/software/seadas/seadas-7.5/ocssw/share/modis/aqua/cal/bt_modisa.hdf
Loading land mask file from /optics1/software/seadas/seadas-7.5/ocssw/share/common/landmask_GMT15ARC.nc
Loading bathymetry mask file from /optics1/software/seadas/seadas-7.5/ocssw/share/common/watermask.dat
Loading ice mask file from /optics1/software/seadas/seadas-7.5/ocssw/var/anc/2019/218/N201921800_SEAICE_NSIDC_24h.hdf
Loaded near real time NSIDC ice HDF file.
Loading elevation file from /optics1/software/seadas/seadas-7.5/ocssw/share/common/ETOPO1_ocssw.nc
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_412.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_443.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_469.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_488.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_531.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_547.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_555.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_645.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_667.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_678.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_748.hdf
Loading XCAL rvs and polarization sensitivities from /optics1/software/seadas/seadas-7.5/ocssw/var/modisa/xcal/OPER/xcal_modisa_axc_oc_v1.30d_869.hdf
Loading DEM info from /optics1/software/seadas/seadas-7.5/ocssw/share/common/ETOPO1_ocssw.nc
-E- /home/seadas/ocssw/src/l2gen/sstref.c : Unable to initialize SST file
/optics1/software/seadas/seadas-7.5/ocssw/var/anc/2019/212/N2019212_SST_OIV2AV_24h.nc 219

So I have deleted that offending N2019212_SST_OIV2AV_24h.nc file and run the processing again, and it downloads the N2019212_SST_OIV2AV_24h.nc file again (exactly the same), but the same failures. Is that file corrupt on your end?

Please advise?

Thanks,
Brock

[OB.DAAC - SeanBailey]

The issue is that when NOAA restarted the process ('twas down for a bit due to a METOPS source problem), the title attribute changed from what was previously written.
Since l2gen uses that string to select the function to read the file, it now fails.

Until we can update l2gen, a quick and dirty fix is to change the tilte back to the expected one:
:title = "NCEI Daily-OISST-V2 based mainly on AVHRR, Final" ;

There should be a script in $OCSSWROOT/scripts called ncattredit.py that can help you do that.

Sean

[oo_processing]

Does this mean that all processing of data that requires AVHRR SST post 2019/212 will now fail until l2gen is updated? If that is the case, how long might this be? Much of my work is real-time and automated. It might be difficult to find a place to call ncattredit.py in the current stream.

Brock

[oo_processing]

BTW, all my previous N2019211 and lower had :

:title = "NCEI Daily-OISST-V2 based mainly on AVHRR, Interim" ;

So I changed it to that, and was able to reprocess the data.

Brock

[OB.DAAC - SeanBailey]

> Does this mean that all processing of data that requires AVHRR SST post 2019/212 will now fail until l2gen is updated? If that is the case, how long might this be?

Yes, unless NOAA reverts the title string.  I'm out of the office until August 14th, so at least until then, if not longer.

The "Interim" version gets replaced by the "Final" version a week or two later.  We process with the interim and reprocess when the final arrive.

Sean

[oo_processing]

Sean,
Any news on the post 2019/212 N20192??_SST_OIV2AV_24h.nc files yet? Or an update to l2gen? I am still having to manually convert them daily.
Cheers,
Brock

[OB ODPS - towens]

l2gen has been patched and the post 2019/212 OI2AV SST files are available for download.

Tommy

[oo_processing]

Tommy,

Can you please advise on the best way to update "just" l2gen?
https://oceancolor.gsfc.nasa.gov/docs/ocssw/md_src_l2gen_Changelog.html

Shows
Unreleased
9.3.0 - 2018-04-09

However, I did a install to another location, and then tried to run the new version which ran. I see there is a large difference in the size of the l2gen file. Is that correct? WIll replacing this file alone work?

[bmurch@optics0 bin]$ pwd; ll ./l2gen /shares/cms_optics/apps/seadas/seadas-7.5/ocssw/bin/l2gen
/shares/cms_optics/apps/seadas-7.5.3/bin
-rwxrwxr-x 1 bmurch cms_optics 4418424 Aug 23 16:46 ./l2gen
-rwxrwxr-x 1 bmurch cms_optics 5178400 Mar 14 10:18 /shares/cms_optics/apps/seadas/seadas-7.5/ocssw/bin/l2gen

Thanks,
Brock

[OB.DAAC - SeanBailey]

No, simply updating the l2gen binary will not work.  The new binaries use shared libraries (well more of them anyway) and so will not work unless you also updated those libraries. BTW, I have not had time to update the externally accessible doxygen pages (in part because I've not updated the externally accessible source) ...on the todo list...it's a long list...

You could try running ldd on the l2gen binary and make sure your $OCSSWROOT/opt/lib directory contains the necessary libraries.

Sean

[oo_processing]

Sean,
Thanks for your advise, I will check. It appears that these are missing:

[bmurch@optics0 bin]$ ldd l2gen_new_753  | grep found
        liboc.so => not found
        libhdf5_hl.so.10.3.0 => not found
        libhdf5.so.10.3.0 => not found
        libboost_filesystem.so.1.69.0 => not found
        libboost_date_time.so.1.69.0 => not found
        libjansson.so.4 => not found

Is it possible to just drop these into the proper opt opt directory? How will that mess up the git?
Or back to the original question of: Is there a way to simply install only what l2gen needs?

Cheers,
Brock