Currupt hdf file in ocssw distribution?

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
alaroy
Posts: 78
Joined: Tue Nov 21, 2006 3:33 pm America/New_York
Answers: 0

Currupt hdf file in ocssw distribution?

by alaroy » Tue Oct 01, 2019 1:20 pm America/New_York

I have a copy of ocssw that I retrieved between 2019-09-30 02:54:54 UTC to 2019-09-30 03:00:35 UTC using the command

install_ocssw.py --install-dir=/tmp/ocssw-fetch/ocssw/ -b v7.5 --aqua --viirsn

when I try to run the l2gen command

l2gen maskland=0 proc_cloud=on  maskcloud=on cloud_thresh=0.1  maskhilt=0 maskstlight=0 resolution=1000 gas_opt=8 l2prod="rhos_667,rhos_748,rhos_869" par=/tmp/ssscratch/ocssw_l1a_to_l2-working/A2019239192000.L1A_LAC.anc ifile=A2019239192000.L1B_LAC geofile=A2019239192000.GEO ofile=A2019239192000.L2_FAI.nc

it fails with the error

...
Number of Diffuse Transmittance Wavelengths    17
Number of Diffuse Transmittance Zenith Angles  33
-E- /home/seadas/ocssw/src/l2gen/aerosol.c:  Error opening file /marine-services/ocssw/share/modis/aqua/aerosol/aerosol_modisa_r80f10v01.hdf.


when I try to hdp the file I get an error so something definitely seems to be amiss with it

$ hdp list /marine-services/ocssw/share/modis/aqua/aerosol/aerosol_modisa_r80f10v01.hdf
HDP ERROR>>> in do_list: Hopen failed - possible invalid file name: /marine-services/ocssw/share/modis/aqua/aerosol/aerosol_modisa_r80f10v01.hdf.

Thinking that maybe I had bad timing and / or the fiile got truncated during the install I tried re-retrieving shortly before posting this, but the aerosol file was exactly the same as was the error, so it seems like the issue is in the ocssw distribution.

Could someone please investigate and post a corrected file if possible? Thank you!

-Andrew L.

Tags:

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1469
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1
Been thanked: 5 times

Currupt hdf file in ocssw distribution?

by OB.DAAC - SeanBailey » Tue Oct 01, 2019 2:11 pm America/New_York

Nope, nothing wrong with files on the distribution server.

I just ran a fresh install and I get:
$ hdp list share/modis/aqua/aerosol/aerosol_modisa_r80f10v01.hdf
File: share/modis/aqua/aerosol/aerosol_modisa_r80f10v01.hdf
Last modified with NCSA HDF Version 4.1 Release 5, November 5, 2001

Version Descriptor  : (tag 30)
        Ref nos: 1
Number type         : (tag 106)
  ...

If there were an issue, git should have barked loudly when you ran the install.

What do you get if you do the following:
$ cd $OCDATAROOT/modis/aqua
$ git status


...it should be
$ git status
On branch v7.5
Your branch is up to date with 'origin/v7.5'.

nothing to commit, working tree clean


Sean

alaroy
Posts: 78
Joined: Tue Nov 21, 2006 3:33 pm America/New_York
Answers: 0

Currupt hdf file in ocssw distribution?

by alaroy » Thu Oct 10, 2019 7:08 am America/New_York

Sean,

I re-fetched yesterday (completely deleted the target directory and retrieved from scratch) and everything seems to work so I'm going to file it as "water under the bridge". Thank you for checking into it!

Post Reply