query new files in directory

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
captlen
Posts: 14
Joined: Mon Jul 18, 2022 11:31 am America/New_York
Answers: 0

query new files in directory

by captlen » Mon Aug 01, 2022 8:10 am America/New_York

Prior to July 29,22 my 616 subscription produced Modis Aqua K490 such as the following for years: A2022201074500.L2_LAC_OC.NC Now on 7-28-22 files have changed to:
AQUA_MODIS.20220724T165001.L2.OC.NRT.nc. These files are unusable with my octave and Matlab scripts. Was this changed an error?

Tags:

OB.DAAC - amscott
User Services
User Services
Posts: 345
Joined: Mon Jun 22, 2020 5:24 pm America/New_York
Answers: 1
Has thanked: 8 times
Been thanked: 3 times

Re: query new files in directory

by OB.DAAC - amscott » Mon Aug 01, 2022 10:02 am America/New_York

This is not an error. NRT files (...OC.NRT.nc) are near real-time and provide a quicklook of data before the ancillary files needed to refine the data are available. After the ancillary files are available, they are used to create the refined product which is named "...OC.nc". Regarding the beginning of the filenames, that is not an error either. We are changing our filenaming convention. As data are reprocessed, they will be named by the newer convention of Mission.Sensor.yyyyThhmmss... (Aqua.MODIS.20220724T165001).

captlen
Posts: 14
Joined: Mon Jul 18, 2022 11:31 am America/New_York
Answers: 0

Re: query new files in directory

by captlen » Mon Aug 01, 2022 11:37 am America/New_York

I am now receiving NRT data from my subscription 616. Will these data be reprocessed into similar data that were usable with my octave and matlab scripts or do I have to rewrite these scripts to extract the K490 data?

OB.DAAC - amscott
User Services
User Services
Posts: 345
Joined: Mon Jun 22, 2020 5:24 pm America/New_York
Answers: 1
Has thanked: 8 times
Been thanked: 3 times

Re: query new files in directory

by OB.DAAC - amscott » Mon Aug 01, 2022 12:03 pm America/New_York

Your script will need to be ready to accept the new naming convention if you intend to pull data that has been reprocessed to R2022. Before that reprocessing, the previous naming format should be expected by your script.

oc.nc files are always generated after ancillary files are ready. This has nothing to do with reprocessing, so the NRT files (oc.nrt.nc) are available 'now' but there will also be an oc.nc file generated as soon as possible. If you are changing your script to accept NRT files, but you *need* the refined product, you should wait for the refined product, rather than change your script to accept NRT files.

captlen
Posts: 14
Joined: Mon Jul 18, 2022 11:31 am America/New_York
Answers: 0

Re: query new files in directory

by captlen » Mon Aug 01, 2022 12:12 pm America/New_York

Thank you for your quick response. My scripts were prepared 8 years ago and I currently haven't any idea who can rewrite them so I can again receive the K490 data from the NASA site.

captlen
Posts: 14
Joined: Mon Jul 18, 2022 11:31 am America/New_York
Answers: 0

Re: query new files in directory

by captlen » Mon Aug 01, 2022 12:24 pm America/New_York

I see said the blind man. Just got the last part of your message. When will the reprocessing be completed so I will be able to receive the same data as I have been for years.

OB.DAAC - amscott
User Services
User Services
Posts: 345
Joined: Mon Jun 22, 2020 5:24 pm America/New_York
Answers: 1
Has thanked: 8 times
Been thanked: 3 times

Re: query new files in directory

by OB.DAAC - amscott » Mon Aug 01, 2022 4:40 pm America/New_York

Let me try to find out if an estimate can be determined at this time...

captlen
Posts: 14
Joined: Mon Jul 18, 2022 11:31 am America/New_York
Answers: 0

Re: query new files in directory

by captlen » Mon Aug 01, 2022 5:36 pm America/New_York

The unusable files are still pouring into my subscription folder. Will these files be changed to usable files.

captlen
Posts: 14
Joined: Mon Jul 18, 2022 11:31 am America/New_York
Answers: 0

Re: query new files in directory

by captlen » Wed Aug 03, 2022 12:38 pm America/New_York

AMSCOTT Please don't forget about my problem. Will I be required to access the oc.nc. data somewhere other than subscriber 616? The oc.nrt.nc data continues to populate my 616 folder.

OB.DAAC - amscott
User Services
User Services
Posts: 345
Joined: Mon Jun 22, 2020 5:24 pm America/New_York
Answers: 1
Has thanked: 8 times
Been thanked: 3 times

Re: query new files in directory

by OB.DAAC - amscott » Wed Aug 03, 2022 3:41 pm America/New_York

Sure, I have left a message on your voicemail. Please give me a call back at your earliest convenience so we can discuss further.

Post Reply