Page 1 of 2

Duplicate Terra granules between 2003 and 2017

Posted: Tue May 31, 2022 4:03 pm America/New_York
by dem1
Hi,

It seems that the L2 browser returns duplicate products for MODIS Terra between around [2003-01-01, 2017-06-24] with roughly 320 granules per day instead of 190.
Example:
https://oceancolor.gsfc.nasa.gov/cgi/browse.pl?sub=level1or2&per=DAY&day=17332&prm=CHL&set=10&mon=17318&sen=tmod&rad=0&frc=0&n=39.7265625&w=5.2734375&id=1654026908.259537&cn=40.48&cs=38.95&cw=4.46&ce=6.04&dnm=D&file=T2017166104000.L2_LAC_OC.nc_CHLOR_A_BRS&ndx=0&wid=170&hgt=254
and
https://oceancolor.gsfc.nasa.gov/cgi/browse.pl?sub=level1or2&per=DAY&day=17332&prm=CHL&set=10&mon=17318&sen=tmod&rad=0&frc=0&n=39.7265625&w=5.2734375&id=1654026908.259537&cn=40.48&cs=38.95&cw=4.46&ce=6.04&dnm=D&file=T2017166104000.L2_LAC_OC.nc_CHLOR_A_BRS&ndx=1&wid=170&hgt=254

Is it normal? Seems like database duplicates.

We try to estimate the size of the whole archive and it seems these duplicates have a big impact on the estimate. We found 1943173 Terra granules vs 1193721 for Aqua which seems suspect if they have the same theoretical number of granules per day (Aqua mission has 22 years of data vs 20 years for Aqua).

Thanks,
Julien

Re: Duplicate Terra granules between 2003 and 2017

Posted: Tue May 31, 2022 10:27 pm America/New_York
by OB ODPS - towens
Our current holdings:
MODISA | level0 | 2,084,721
MODIST | level0 | 2,320,268

Tommy

Re: Duplicate Terra granules between 2003 and 2017

Posted: Wed Jun 01, 2022 4:03 am America/New_York
by dem1
Thanks for your answer Tommy, but this does not explain why the browser list duplicates L1? The two swaths in my example are real duplicates because L0 to L2 products have the same name.
I obtain my numbers by selecting the whole mission on the browser, select Day products only, then click on "Find swaths".

Re: Duplicate Terra granules between 2003 and 2017

Posted: Wed Jun 01, 2022 7:46 am America/New_York
by OB ODPS - towens
The web developers are looking into the duplication in the browser results.

Tommy

Re: Duplicate Terra granules between 2003 and 2017

Posted: Wed Jun 01, 2022 11:16 am America/New_York
by OB ODPS - jgwilding
Hi Julien,

We are unable to reproduce the duplicate results. I've attached a screenshot from our browser where we have navigated to the same date. Can you post a screenshot that shows the duplicate results?

john
Screenshot from 2022-06-01 15-11-39.png
Screenshot from 2022-06-01 15-11-39.png (303.08 KiB) Not viewed yet
Screenshot from 2022-06-01 15-11-39.png
Screenshot from 2022-06-01 15-11-39.png (303.08 KiB) Not viewed yet

Re: Duplicate Terra granules between 2003 and 2017

Posted: Wed Jun 01, 2022 11:40 am America/New_York
by dem1
Hi John,

Below 4 screenshots for:
- the main L2 browser where I selected the sensor, date and then clicked on France on the map
- the search result which shows the 2 duplicates
- the detail of each duplicate where you can see at the bottom "Number of swaths: 1st of 2 swaths" for the first and "Number of swaths: 2nd of 2 swaths" for the second granule. All other info are identical.

Thanks,
Julien

Re: Duplicate Terra granules between 2003 and 2017

Posted: Wed Jun 01, 2022 11:41 am America/New_York
by dem1
The second granule:

Re: Duplicate Terra granules between 2003 and 2017

Posted: Wed Jun 01, 2022 12:39 pm America/New_York
by OB ODPS - jgwilding
Hi Julien.

Thank you for posting your screenshots. We have been able to replicate the problem and are investigating. It appears to be an issue with the query that is used for the page that results from the Find Swaths operation. The granules that appear as duplicates have the characteristic of having data for multiple days. It does not mean that we have duplicate copies of those granules in our archive.

john

Re: Duplicate Terra granules between 2003 and 2017

Posted: Wed Jun 01, 2022 4:37 pm America/New_York
by dem1
Thanks a lot John for the quick investigation!
Note that this granule doesn't seem to have data on multiple days because its start time is 10:40

Re: Duplicate Terra granules between 2003 and 2017

Posted: Wed Jun 08, 2022 2:05 pm America/New_York
by OB WebDev - masoudso
Hi Julien,
This issue has been resolved.

Thanks,
Masoud