Page 1 of 1

query new files in directory

Posted: Mon Aug 01, 2022 8:10 am America/New_York
by captlen
Prior to July 29,22 my 616 subscription produced Modis Aqua K490 such as the following for years: A2022201074500.L2_LAC_OC.NC Now on 7-28-22 files have changed to:
AQUA_MODIS.20220724T165001.L2.OC.NRT.nc. These files are unusable with my octave and Matlab scripts. Was this changed an error?

Re: query new files in directory

Posted: Mon Aug 01, 2022 10:02 am America/New_York
by OB.DAAC - amscott
This is not an error. NRT files (...OC.NRT.nc) are near real-time and provide a quicklook of data before the ancillary files needed to refine the data are available. After the ancillary files are available, they are used to create the refined product which is named "...OC.nc". Regarding the beginning of the filenames, that is not an error either. We are changing our filenaming convention. As data are reprocessed, they will be named by the newer convention of Mission.Sensor.yyyyThhmmss... (Aqua.MODIS.20220724T165001).

Re: query new files in directory

Posted: Mon Aug 01, 2022 11:37 am America/New_York
by captlen
I am now receiving NRT data from my subscription 616. Will these data be reprocessed into similar data that were usable with my octave and matlab scripts or do I have to rewrite these scripts to extract the K490 data?

Re: query new files in directory

Posted: Mon Aug 01, 2022 12:03 pm America/New_York
by OB.DAAC - amscott
Your script will need to be ready to accept the new naming convention if you intend to pull data that has been reprocessed to R2022. Before that reprocessing, the previous naming format should be expected by your script.

oc.nc files are always generated after ancillary files are ready. This has nothing to do with reprocessing, so the NRT files (oc.nrt.nc) are available 'now' but there will also be an oc.nc file generated as soon as possible. If you are changing your script to accept NRT files, but you *need* the refined product, you should wait for the refined product, rather than change your script to accept NRT files.

Re: query new files in directory

Posted: Mon Aug 01, 2022 12:12 pm America/New_York
by captlen
Thank you for your quick response. My scripts were prepared 8 years ago and I currently haven't any idea who can rewrite them so I can again receive the K490 data from the NASA site.

Re: query new files in directory

Posted: Mon Aug 01, 2022 12:24 pm America/New_York
by captlen
I see said the blind man. Just got the last part of your message. When will the reprocessing be completed so I will be able to receive the same data as I have been for years.

Re: query new files in directory

Posted: Mon Aug 01, 2022 4:40 pm America/New_York
by OB.DAAC - amscott
Let me try to find out if an estimate can be determined at this time...

Re: query new files in directory

Posted: Mon Aug 01, 2022 5:36 pm America/New_York
by captlen
The unusable files are still pouring into my subscription folder. Will these files be changed to usable files.

Re: query new files in directory

Posted: Wed Aug 03, 2022 12:38 pm America/New_York
by captlen
AMSCOTT Please don't forget about my problem. Will I be required to access the oc.nc. data somewhere other than subscriber 616? The oc.nrt.nc data continues to populate my 616 folder.

Re: query new files in directory

Posted: Wed Aug 03, 2022 3:41 pm America/New_York
by OB.DAAC - amscott
Sure, I have left a message on your voicemail. Please give me a call back at your earliest convenience so we can discuss further.