Ancillary file delay

stgo · by **stgo** » Sat Dec 07, 2019 6:42 am America/New_York

Hi,

Files between 1455 and 1635 haven't been posted for yesterday:
PM1ATTNR_NRT.A2019340.1455.061
PM1ATTNR_NRT.A2019340.1635.061

Do you know if these will be posted today?

Thanks,
Stephen

OB.DAACx - SeanBailey · by **OB.DAACx - SeanBailey** » Sat Dec 07, 2019 8:54 am America/New_York

Lack of presence on the "Direct Access" web pages doesn't necessarily imply lack of availability. Sometimes a hamster escapes the wheel.
The files are available. Try the file_search API:

wget --post-data="search=PM1ATTNR_NRT.A2019340.15*.061&results_as_file=1&addurl=1" -O - https://oceandata.sci.gsfc.nasa.gov/api/file_search

wget --post-data="search=PM1ATTNR_NRT.A2019340.16*.061&results_as_file=1&addurl=1" -O - https://oceandata.sci.gsfc.nasa.gov/api/file_search

I'll ask the hamster wranglers to round up the missing critters on Monday.

Sean

oo_processing · by **oo_processing** » Mon Dec 09, 2019 7:51 pm America/New_York

Not sure if the hamster is in a different place?
I've been suffering failures today, getting these error messages in my logs:

STATUS: $ocssw_command_2 = modis_GEO.py --parfile=./2019343165502.atteph.fixed /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.BERMUDA.2019.343_version_0.08_jpA5qhVB/MOD00.P2019343.1655.BERMUDA_FULL.L1A_LAC -o /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.BERMUDA.2019.343_version_0.08_jpA5qhVB/MOD00.P2019343.1655.BERMUDA_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
[55144 refs]
STATUS: $ocssw_return_2 = ./2019343165502.atteph.fixed
{'geogen': {'a1': '/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2019/343/PM1ATTNR_NRT.A2019343.1650.061', 'a2': '/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2019/343/PM1ATTNR_NRT.A2019343.1655.061'}}
/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2019/343/PM1ATTNR_NRT.A2019343.1650.061
/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2019/343/PM1ATTNR_NRT.A2019343.1655.061
ERROR: User must specify attitude AND ephemeris files.

OB.DAACx - SeanBailey · by **OB.DAACx - SeanBailey** » Tue Dec 10, 2019 8:50 am America/New_York

no, but seems two hamsters decided to take daddy's Corvette to the track and have a race overnight...the loser wasn't allowed to show his face.
Sorting out now...

oo_processing · by **oo_processing** » Wed Dec 11, 2019 8:07 am America/New_York

Sean,

They are almost all through now. 1 is left hanging:

STATUS: $ocssw_command_2 = modis_GEO.py --parfile=./2019344110002.atteph.fixed /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.PERSIAN_GULF.2019.344_version_0.08__5_6HO5O/MOD00.P2019344.1100.PERSIAN_GULF_FULL.L1A_LAC -o /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.PERSIAN_GULF.2019.344_version_0.08__5_6HO5O/MOD00.P2019344.1100.PERSIAN_GULF_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
[55144 refs]
STATUS: $ocssw_return_2 = ./2019344110002.atteph.fixed
{'geogen': {'e1': '/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2019/344/PM1EPHND_NRT.A2019344.1055.061', 'e2': '/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2019/344/PM1EPHND_NRT.A2019344.1100.061'}}
/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2019/344/PM1EPHND_NRT.A2019344.1055.061
/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2019/344/PM1EPHND_NRT.A2019344.1100.061
ERROR: User must specify attitude AND ephemeris files.
Attitude/ephemeris files must ALL be specified or NONE specified. Exiting.

OB.DAACx - SeanBailey · by **OB.DAACx - SeanBailey** » Wed Dec 11, 2019 1:36 pm America/New_York

Still sorting...a few files seem to be stubborn...

oo_processing · by **oo_processing** » Wed Dec 11, 2019 1:42 pm America/New_York

Yes, I noticed a few more are stuck now :)

OB.DAACx - SeanBailey · by **OB.DAACx - SeanBailey** » Thu Dec 12, 2019 10:14 am America/New_York

Should be happy again...I hope:eek:

oo_processing · by **oo_processing** » Thu Dec 12, 2019 7:08 pm America/New_York

Sadly something is still amiss... I have 44 or these sitting in the fail jar:

STATUS: $ocssw_command_2 = modis_GEO.py --parfile=./2019346190502.atteph.fixed /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.SE_FL.2019.346_version_0.08_ZloZpSZw/MOD00.P2019346.1905.SE_FL_FULL.L1A_LAC -o /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.SE_FL.2019.346_version_0.08_ZloZpSZw/MOD00.P2019346.1905.SE_FL_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
[66401 refs]
STATUS: $ocssw_return_2 = ./2019346190502.atteph.fixed
{'geogen': {}}
Missing attitude files!
Missing ephemeris files!

And

STATUS: $ocssw_command_2 = modis_GEO.py --parfile=./2019346190502.atteph.fixed /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.BIGBEND.2019.346_version_0.08_OJWqQ3ms/MOD00.P2019346.1905.BIGBEND_FULL.L1A_LAC -o /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.BIGBEND.2019.346_version_0.08_OJWqQ3ms/MOD00.P2019346.1905.BIGBEND_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
[66401 refs]
STATUS: $ocssw_return_2 = ./2019346190502.atteph.fixed
{'geogen': {}}
Missing attitude files!
Missing ephemeris files!

OB.DAACx - SeanBailey · by **OB.DAACx - SeanBailey** » Thu Dec 12, 2019 7:28 pm America/New_York

Yeah...as I was leaving this afternoon I saw my data production manager and web guru scratching their heads...
Something is indeed not right in the sync between production and web... Stay tuned...

Sean