Search found 295 matches

by oo_processing
Wed May 13, 2020 1:55 pm America/New_York
Forum: Questions/Comments
Question: PDS files in subscriptions now in both bz2 and 'data' format
Replies: 16

PDS files in subscriptions now in both bz2 and 'data' format

John,The local files have the same name as the ones on the server.BUT, and a huge BUT..I have an automated system that creates work-orders and checks old work-orders and all kinds of stuff.So, I can parse the name to see if it is bz2, however that is placed into a hash.That hash is passed around and...
by oo_processing
Wed May 13, 2020 1:28 pm America/New_York
Forum: Questions/Comments
Question: PDS files in subscriptions now in both bz2 and 'data' format
Replies: 16

PDS files in subscriptions now in both bz2 and 'data' format

Thanks Tommy,
For now, I am just skipping the ones that are not bz2.
There are so many things that happen with the hash element that the granules are stored in, that it will be a nightmare to change everything.
Brock
by oo_processing
Wed May 13, 2020 12:08 pm America/New_York
Forum: Questions/Comments
Question: PDS files in subscriptions now in both bz2 and 'data' format
Replies: 16

PDS files in subscriptions now in both bz2 and 'data' format

Sean,There seems to be an issue which began on May 6th. It is happening in at least 21 of my subscriptions. Here is the result of a query just performed:[bmurch@dell8 ~]$ curl  --retry 5 --retry-delay 2 -d "subID=1843&results_as_file=1"  https://oceandata.sci.gsfc.nasa.gov/ap...
by oo_processing
Tue Mar 10, 2020 1:54 pm America/New_York
Forum: Questions/Comments
Question: Pass processed NRT OK, reprocess 5 days later fails?
Replies: 1

Pass processed NRT OK, reprocess 5 days later fails?

Sean,Sorry for the long post. But... I ran this combined granule NRT on 2020-03-05 13:53:07 , and it failed as happens when finding a new way to do things. II ran it again at 2020-03-05 15:02:38 (still NRT) and it was was successful. However, I reprocess things days later, and that failed at the pla...
by oo_processing
Thu Feb 20, 2020 1:58 pm America/New_York
Forum: Questions/Comments
Question: Aqua Mini - Reproc
Replies: 1

Aqua Mini - Reproc

Sean,I saw your email about reprocessing, specifically:"...calibration trend beginning in August of 2019.  The impact, while small, was deemed significant enough - especially toward late 2019/ early 2020"I assume that the LUT update from last night (below) was for this purpose?If so, ...
by oo_processing
Tue Feb 18, 2020 11:32 am America/New_York
Forum: Questions/Comments
Question: Ancillary file delay
Replies: 25

Ancillary file delay

Sean,This becomes very tedious and fast. I have scripts that run every 1/2 hour and if subscription file is stages, I grab it.And I restart failed jobs  every hour, so some go through several failures. And as a result, it appears that the .usr_cookies file is often corruptedWhen the subscriptio...
by oo_processing
Mon Feb 17, 2020 11:28 am America/New_York
Forum: Questions/Comments
Question: terra LUTS
Replies: 1

terra LUTS

Sean,I know that you mentioned that there was an issue with the terra LUTS. I see they were updated on Friday so I will assume they were corrected. Can you remind us how far back were should go to reprocess this data?Thanks,BrockDownloading files into $OCSSW/var/modist/xcal/OPER+ xcal_modist_txc_oc_...
by oo_processing
Fri Feb 14, 2020 1:38 pm America/New_York
Forum: Questions/Comments
Question: atteph failing
Replies: 2

atteph failing

I had had several modis aqua passes fail in the same way.To determine what atteph files I need in advance (as the -d must be used now) I run:searobin 870 :> modis_atteph.py -d MOD00.P2020045.0620.CAPE_COD_FULL.L1A_LACAquaatt1=/optics1/software/seadas/seadas-7.5/ocssw/var/anc/2020/045/PM1ATTNR_NRT.A2...
by oo_processing
Wed Feb 12, 2020 9:29 pm America/New_York
Forum: Questions/Comments
Question: Ancillary file delay
Replies: 25

Ancillary file delay

No, the problem clears up eventually.
I suspect that the subscriptions are filled prior to the anc data being available, or in the database that the scripts query.
But it is an ongoing problem.

Brock
by oo_processing
Wed Feb 12, 2020 1:04 pm America/New_York
Forum: Questions/Comments
Question: Ancillary file delay
Replies: 25

Ancillary file delay

And again today:modis_GEO.py --parfile=./MOD00.P2020042.1325.ANGOLA_FULL.L1A_LAC.atteph.fixed MOD00.P2020042.1325.ANGOLA_FULL.L1A_LAC -o MOD00.P2020042.1325.ANGOLA_FULL.GEO --threshold=95 --ancdb=./ancillary_data.dbSTATUS: $ocssw_return_2 = ./MOD00.P2020042.1325.ANGOLA_FULL.L1A_LAC.atteph.fixed{'...