Forum

Hi, Is there another HTTP backup/redundant server for https://oceandata.sci.gsfc.nasa.gov which could be used in case of server failure or temporary IP blacklisting? Sorry for the question but we are exploring possibilities to improve our robustness in case of issue, so if a redundant server exists ...

Hi,

It seems that the full MODIS-Aqua archive has just been reprocessed again at the beginning of September?
What are the changes compared to the previous MODIS-Aqua R2022 release?

Thanks,
Julien

Hi, Since 3 weeks we successfully got back to search requests by 30-days periods, but the same problem came back since 01 September 4:00pm UTC, the searchs timeout after 5 minutes and you can see on the log of this morning below that some requests are successful but are very long, more than 3-4 minu...

Hi, We found that with R2022 the granule start time in the new filenaming convention is not consistent with R2018: with R2018 seconds were always set to 00, but with R2022 there is a mix of 00 and 01, is it normal? Example: R2018: A2003001004500.L2_LAC_OC.nc A2003001005000.L2_LAC_OC.nc A200300100550...

Thanks a lot again Sean for your detailed explanations, it is now a lot more clear for me! The new .NRT suffix allows to identify quickly NRT files, which is fine, and having now only NRT and RF is less confusing than RF/QL/QLP I think. The only drawback is that for the moment we have to handle both...

Thanks a lot for your answer Sean, I was also in vacation last week and I can confirm that read work emails during vacations is not a good idea for vacation health! ;-) I'm a bit surprised that there is no more QLP with the R2022 Aqua reprocessing. With previous Aqua reprocessing we have typically a...

Hi, The new file naming convention introduces a .NRT prefix for Near Real Time products. How is it related to previous QLP, QL and RF consolidation flavors? Does the .NRT suffix include QLP and QL products? With previous reprocessings we used the processing_version NetCDF attribute to differentiate ...

Hi, The issue seems getting worse: since 2022-07-05 4pm UTC my workaround to split by 5 days no more works and at least this request always timeouts (after 300s): 2022-07-06 08:38:49,753 [INFO] session.request('POST', 'https://oceandata.sci.gsfc.nasa.gov/api/file_search', data={'sensor': 'aqua', 'sd...

Thanks a lot Sean! I have done more analysis: previously I split my search requests by sensor and month I tried to reduce the split period to 10 days but I still had timeouts, see the detailed log below: most of the time the requests are fast (note that our code ensure a minimum delay of 5s between ...

Example of request which always fails: 2022-06-27 11:41:32,495 [INFO] session.request('POST', 'https://oceandata.sci.gsfc.nasa.gov/api/file_search', data={'sensor': 'aqua', 'sdate': '2021-12-09', 'edate': '2021-12-31', 'psdate': '2021-12-09', 'pedate': None, 'dtype': 'L2', 'search': 'A*.L2_LAC_OC.nc...