Duplicate Terra granules between 2003 and 2017
Duplicate Terra granules between 2003 and 2017
Hi,
It seems that the L2 browser returns duplicate products for MODIS Terra between around [2003-01-01, 2017-06-24] with roughly 320 granules per day instead of 190.
Example:
https://oceancolor.gsfc.nasa.gov/cgi/browse.pl?sub=level1or2&per=DAY&day=17332&prm=CHL&set=10&mon=17318&sen=tmod&rad=0&frc=0&n=39.7265625&w=5.2734375&id=1654026908.259537&cn=40.48&cs=38.95&cw=4.46&ce=6.04&dnm=D&file=T2017166104000.L2_LAC_OC.nc_CHLOR_A_BRS&ndx=0&wid=170&hgt=254
and
https://oceancolor.gsfc.nasa.gov/cgi/browse.pl?sub=level1or2&per=DAY&day=17332&prm=CHL&set=10&mon=17318&sen=tmod&rad=0&frc=0&n=39.7265625&w=5.2734375&id=1654026908.259537&cn=40.48&cs=38.95&cw=4.46&ce=6.04&dnm=D&file=T2017166104000.L2_LAC_OC.nc_CHLOR_A_BRS&ndx=1&wid=170&hgt=254
Is it normal? Seems like database duplicates.
We try to estimate the size of the whole archive and it seems these duplicates have a big impact on the estimate. We found 1943173 Terra granules vs 1193721 for Aqua which seems suspect if they have the same theoretical number of granules per day (Aqua mission has 22 years of data vs 20 years for Aqua).
Thanks,
Julien
It seems that the L2 browser returns duplicate products for MODIS Terra between around [2003-01-01, 2017-06-24] with roughly 320 granules per day instead of 190.
Example:
https://oceancolor.gsfc.nasa.gov/cgi/browse.pl?sub=level1or2&per=DAY&day=17332&prm=CHL&set=10&mon=17318&sen=tmod&rad=0&frc=0&n=39.7265625&w=5.2734375&id=1654026908.259537&cn=40.48&cs=38.95&cw=4.46&ce=6.04&dnm=D&file=T2017166104000.L2_LAC_OC.nc_CHLOR_A_BRS&ndx=0&wid=170&hgt=254
and
https://oceancolor.gsfc.nasa.gov/cgi/browse.pl?sub=level1or2&per=DAY&day=17332&prm=CHL&set=10&mon=17318&sen=tmod&rad=0&frc=0&n=39.7265625&w=5.2734375&id=1654026908.259537&cn=40.48&cs=38.95&cw=4.46&ce=6.04&dnm=D&file=T2017166104000.L2_LAC_OC.nc_CHLOR_A_BRS&ndx=1&wid=170&hgt=254
Is it normal? Seems like database duplicates.
We try to estimate the size of the whole archive and it seems these duplicates have a big impact on the estimate. We found 1943173 Terra granules vs 1193721 for Aqua which seems suspect if they have the same theoretical number of granules per day (Aqua mission has 22 years of data vs 20 years for Aqua).
Thanks,
Julien
Last edited by dem1 on Wed Jun 01, 2022 3:03 am America/New_York, edited 1 time in total.
Filters:
-
- Subject Matter Expert
- Posts: 450
- Joined: Fri Feb 05, 2021 9:17 am America/New_York
- Been thanked: 7 times
Re: Duplicate Terra granules between 2003 and 2017
Our current holdings:
MODISA | level0 | 2,084,721
MODIST | level0 | 2,320,268
Tommy
MODISA | level0 | 2,084,721
MODIST | level0 | 2,320,268
Tommy
Re: Duplicate Terra granules between 2003 and 2017
Thanks for your answer Tommy, but this does not explain why the browser list duplicates L1? The two swaths in my example are real duplicates because L0 to L2 products have the same name.
I obtain my numbers by selecting the whole mission on the browser, select Day products only, then click on "Find swaths".
I obtain my numbers by selecting the whole mission on the browser, select Day products only, then click on "Find swaths".
-
- Subject Matter Expert
- Posts: 450
- Joined: Fri Feb 05, 2021 9:17 am America/New_York
- Been thanked: 7 times
Re: Duplicate Terra granules between 2003 and 2017
The web developers are looking into the duplication in the browser results.
Tommy
Tommy
-
- Subject Matter Expert
- Posts: 139
- Joined: Fri Feb 19, 2021 1:09 pm America/New_York
- Been thanked: 1 time
Re: Duplicate Terra granules between 2003 and 2017
Hi Julien,
We are unable to reproduce the duplicate results. I've attached a screenshot from our browser where we have navigated to the same date. Can you post a screenshot that shows the duplicate results?
john
We are unable to reproduce the duplicate results. I've attached a screenshot from our browser where we have navigated to the same date. Can you post a screenshot that shows the duplicate results?
john
Re: Duplicate Terra granules between 2003 and 2017
Hi John,
Below 4 screenshots for:
- the main L2 browser where I selected the sensor, date and then clicked on France on the map
- the search result which shows the 2 duplicates
- the detail of each duplicate where you can see at the bottom "Number of swaths: 1st of 2 swaths" for the first and "Number of swaths: 2nd of 2 swaths" for the second granule. All other info are identical.
Thanks,
Julien
Below 4 screenshots for:
- the main L2 browser where I selected the sensor, date and then clicked on France on the map
- the search result which shows the 2 duplicates
- the detail of each duplicate where you can see at the bottom "Number of swaths: 1st of 2 swaths" for the first and "Number of swaths: 2nd of 2 swaths" for the second granule. All other info are identical.
Thanks,
Julien
- Attachments
-
- searchresult.png (36.32 KiB) Not viewed yet
-
- granule1.png (265.69 KiB) Not viewed yet
-
- main.png (172.86 KiB) Not viewed yet
Re: Duplicate Terra granules between 2003 and 2017
The second granule:
- Attachments
-
- granule2.png (265.44 KiB) Not viewed yet
-
- Subject Matter Expert
- Posts: 139
- Joined: Fri Feb 19, 2021 1:09 pm America/New_York
- Been thanked: 1 time
Re: Duplicate Terra granules between 2003 and 2017
Hi Julien.
Thank you for posting your screenshots. We have been able to replicate the problem and are investigating. It appears to be an issue with the query that is used for the page that results from the Find Swaths operation. The granules that appear as duplicates have the characteristic of having data for multiple days. It does not mean that we have duplicate copies of those granules in our archive.
john
Thank you for posting your screenshots. We have been able to replicate the problem and are investigating. It appears to be an issue with the query that is used for the page that results from the Find Swaths operation. The granules that appear as duplicates have the characteristic of having data for multiple days. It does not mean that we have duplicate copies of those granules in our archive.
john
Re: Duplicate Terra granules between 2003 and 2017
Thanks a lot John for the quick investigation!
Note that this granule doesn't seem to have data on multiple days because its start time is 10:40
Note that this granule doesn't seem to have data on multiple days because its start time is 10:40
Re: Duplicate Terra granules between 2003 and 2017
Hi Julien,
This issue has been resolved.
Thanks,
Masoud
This issue has been resolved.
Thanks,
Masoud