Missing VJ109H1 scenes in Earthdata cloud

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
piyush
Posts: 14
Joined: Mon Sep 28, 2020 3:29 pm America/New_York
Answers: 0

Missing VJ109H1 scenes in Earthdata cloud

by piyush » Fri Jul 28, 2023 9:53 pm America/New_York

Hi,

About 2288 granules of VJ109H1 appear to be missing from the earthdata cloud buckets even though CMR reports it as available. Most of the scenes appear to be from Early 2021.

Piyush

Tags:

piyush
Posts: 14
Joined: Mon Sep 28, 2020 3:29 pm America/New_York
Answers: 0

Re: Missing VJ109H1 scenes in Earthdata cloud

by piyush » Mon Jul 31, 2023 2:36 pm America/New_York

Here is a sample list of missing granules:

VJ109H1.A2021009.h23v08.002.2022314174914
VJ109H1.A2021001.h23v10.002.2022312052906
VJ109H1.A2021009.h28v06.002.2022314174942
VJ109H1.A2021001.h15v11.002.2022312064143
VJ109H1.A2021001.h28v14.002.2022312080612
VJ109H1.A2021001.h17v01.002.2022312052840
VJ109H1.A2021001.h03v09.002.2022312052742
VJ109H1.A2021009.h26v02.002.2022314174939
VJ109H1.A2021009.h11v02.002.2022314161140
VJ109H1.A2021009.h20v13.002.2022314174847

LP DAAC - dgolon
User Services
User Services
Posts: 235
Joined: Mon Sep 30, 2019 10:00 am America/New_York
Answers: 0
Has thanked: 12 times
Been thanked: 1 time
Contact:

Re: Missing VJ109H1 scenes in Earthdata cloud

by LP DAAC - dgolon » Mon Jul 31, 2023 3:43 pm America/New_York

Hi @piyush Thanks for bringing this up. We'll look into it and write back when we have more information.
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.

Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.

LP DAAC - dgolon
User Services
User Services
Posts: 235
Joined: Mon Sep 30, 2019 10:00 am America/New_York
Answers: 0
Has thanked: 12 times
Been thanked: 1 time
Contact:

Re: Missing VJ109H1 scenes in Earthdata cloud

by LP DAAC - dgolon » Tue Aug 15, 2023 11:41 am America/New_York

Hello @piyush Apologies for the delay in response. All of the granules you listed are now available. Thank you.
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.

Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.

piyush
Posts: 14
Joined: Mon Sep 28, 2020 3:29 pm America/New_York
Answers: 0

Re: Missing VJ109H1 scenes in Earthdata cloud

by piyush » Tue Aug 15, 2023 1:37 pm America/New_York

We are still seeing about a couple of thousand granules missing. The list I provided was just a subset to help diagnose the issue. We are able to provide the complete list if it helps.
Last edited by piyush on Tue Aug 15, 2023 1:38 pm America/New_York, edited 1 time in total.

LP DAAC - dgolon
User Services
User Services
Posts: 235
Joined: Mon Sep 30, 2019 10:00 am America/New_York
Answers: 0
Has thanked: 12 times
Been thanked: 1 time
Contact:

Re: Missing VJ109H1 scenes in Earthdata cloud

by LP DAAC - dgolon » Thu Aug 17, 2023 3:53 pm America/New_York

Hello @piyush VJ109H1 is a cloud based dataset, so it will not be on our on-prem Data Pool. The data are in CMR and should be up to date, with a leeway of 1 week for new or reprocessed data to be available in CMR. I have spot checked a few scenes and have not found any missing yet. Please send your list to lpdaac@usgs.gov with Attn Danielle in the subject line and we'll run a script to confirm if those scenes are still missing. Once we identify any missing scenes I'll follow up with our Science Data Life Cycle and CMR team to check on the status of the missing scenes. Thanks! - Danielle
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.

Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.

LP DAAC - dgolon
User Services
User Services
Posts: 235
Joined: Mon Sep 30, 2019 10:00 am America/New_York
Answers: 0
Has thanked: 12 times
Been thanked: 1 time
Contact:

Re: Missing VJ109H1 scenes in Earthdata cloud

by LP DAAC - dgolon » Thu Sep 07, 2023 9:46 am America/New_York

Hi @piyush Just wanted to leave a comment to update you. The files have been reingested and are now available. Some of the files were reprocessed, so we encourage you to download the most recent granules. If they were updated, the new granules will have a new processing time of 20230801. Thank you,
Danielle
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.

Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.

piyush
Posts: 14
Joined: Mon Sep 28, 2020 3:29 pm America/New_York
Answers: 0

Re: Missing VJ109H1 scenes in Earthdata cloud

by piyush » Fri Sep 08, 2023 1:53 pm America/New_York

Hi,
Unfortunately, we don't see any changes at our end. CMR still appears to show these granules as missing. Probably because CMR is not up-to-date.

Piyush

LP DAAC - dgolon
User Services
User Services
Posts: 235
Joined: Mon Sep 30, 2019 10:00 am America/New_York
Answers: 0
Has thanked: 12 times
Been thanked: 1 time
Contact:

Re: Missing VJ109H1 scenes in Earthdata cloud

by LP DAAC - dgolon » Tue Sep 19, 2023 2:48 pm America/New_York

Hi @piyush We are seeing all the files you mentioned in CMR on our end. Could you please try clearing your cache and/or try downloading the data from a different browser? If you are still not successful after that, please let me know. Thanks - Danielle
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.

Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.

piyush
Posts: 14
Joined: Mon Sep 28, 2020 3:29 pm America/New_York
Answers: 0

Re: Missing VJ109H1 scenes in Earthdata cloud

by piyush » Tue Sep 19, 2023 3:01 pm America/New_York

Hi,
We access the CMR programatically and not via a browser. I just reran the check and we don't see any new granules ingested in the date range 2021-01-01 and 2021-02-01.

Piyush

Post Reply