Search found 99 matches

by dem1
Fri Sep 09, 2022 11:47 am America/New_York
Forum: Home
Question: MODIS-Aqua archive reprocessed again?
Replies: 1

MODIS-Aqua archive reprocessed again?

Hi,

It seems that the full MODIS-Aqua archive has just been reprocessed again at the beginning of September?
What are the changes compared to the previous MODIS-Aqua R2022 release?

Thanks,
Julien
by dem1
Mon Sep 05, 2022 3:46 am America/New_York
Forum: Home
Question: File Search broken ?
Replies: 15

Re: File Search broken ?

Hi, Since 3 weeks we successfully got back to search requests by 30-days periods, but the same problem came back since 01 September 4:00pm UTC, the searchs timeout after 5 minutes and you can see on the log of this morning below that some requests are successful but are very long, more than 3-4 minu...
by dem1
Tue Aug 16, 2022 5:31 am America/New_York
Forum: Home
Question: MODIS Aqua R2022 granule start time vs R2018
Replies: 4

MODIS Aqua R2022 granule start time vs R2018

Hi, We found that with R2022 the granule start time in the new filenaming convention is not consistent with R2018: with R2018 seconds were always set to 00, but with R2022 there is a mix of 00 and 01, is it normal? Example: R2018: A2003001004500.L2_LAC_OC.nc A2003001005000.L2_LAC_OC.nc A200300100550...
by dem1
Fri Aug 05, 2022 10:48 am America/New_York
Forum: Home
Question: MODIS Aqua new file naming and QLP QL RF
Replies: 5

Re: MODIS Aqua new file naming and QLP QL RF

Thanks a lot again Sean for your detailed explanations, it is now a lot more clear for me! The new .NRT suffix allows to identify quickly NRT files, which is fine, and having now only NRT and RF is less confusing than RF/QL/QLP I think. The only drawback is that for the moment we have to handle both...
by dem1
Fri Aug 05, 2022 7:00 am America/New_York
Forum: Home
Question: MODIS Aqua new file naming and QLP QL RF
Replies: 5

Re: MODIS Aqua new file naming and QLP QL RF

Thanks a lot for your answer Sean, I was also in vacation last week and I can confirm that read work emails during vacations is not a good idea for vacation health! ;-) I'm a bit surprised that there is no more QLP with the R2022 Aqua reprocessing. With previous Aqua reprocessing we have typically a...
by dem1
Thu Aug 04, 2022 10:34 am America/New_York
Forum: Home
Question: MODIS Aqua new file naming and QLP QL RF
Replies: 5

MODIS Aqua new file naming and QLP QL RF

Hi, The new file naming convention introduces a .NRT prefix for Near Real Time products. How is it related to previous QLP, QL and RF consolidation flavors? Does the .NRT suffix include QLP and QL products? With previous reprocessings we used the processing_version NetCDF attribute to differentiate ...
by dem1
Wed Jul 06, 2022 7:47 am America/New_York
Forum: Home
Question: File Search broken ?
Replies: 15

Re: File Search broken ?

Hi, The issue seems getting worse: since 2022-07-05 4pm UTC my workaround to split by 5 days no more works and at least this request always timeouts (after 300s): 2022-07-06 08:38:49,753 [INFO] session.request('POST', 'https://oceandata.sci.gsfc.nasa.gov/api/file_search', data={'sensor': 'aqua', 'sd...
by dem1
Thu Jun 30, 2022 6:45 am America/New_York
Forum: Home
Question: File Search broken ?
Replies: 15

Re: File Search broken ?

Thanks a lot Sean! I have done more analysis: previously I split my search requests by sensor and month I tried to reduce the split period to 10 days but I still had timeouts, see the detailed log below: most of the time the requests are fast (note that our code ensure a minimum delay of 5s between ...
by dem1
Mon Jun 27, 2022 6:01 am America/New_York
Forum: Home
Question: File Search broken ?
Replies: 15

Re: File Search broken ?

Example of request which always fails: 2022-06-27 11:41:32,495 [INFO] session.request('POST', 'https://oceandata.sci.gsfc.nasa.gov/api/file_search', data={'sensor': 'aqua', 'sdate': '2021-12-09', 'edate': '2021-12-31', 'psdate': '2021-12-09', 'pedate': None, 'dtype': 'L2', 'search': 'A*.L2_LAC_OC.nc...
by dem1
Mon Jun 27, 2022 5:12 am America/New_York
Forum: Home
Question: File Search broken ?
Replies: 15

Re: File Search broken ?

Hi,

The same problem came back since 25 June 10:00pm UTC, the search timeouts after 5 minutes depending on period (and the issue seems varying from one request to another).

Thanks,
Julien