Delay in publication to s3://prod-lads

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
piyush
Posts: 17
Joined: Mon Sep 28, 2020 3:29 pm America/New_York
Answers: 0

Delay in publication to s3://prod-lads

by piyush » Wed May 03, 2023 5:05 pm America/New_York

There appears to be a delay of several days between products being available via ladsweb and the prod-lads s3 bucket. This delay also appears to be consistent with metadata being published late to CMR. An example is the VNP46A2 product.

Is there a plan to publish to the s3 bucket at the same time as the ladsweb portal?

Filters:

LAADS_UserServices_M
User Services
User Services
Posts: 299
Joined: Mon Sep 30, 2019 8:33 am America/New_York
Answers: 1
Has thanked: 3 times

Re: Delay in publication to s3://prod-lads

by LAADS_UserServices_M » Fri May 05, 2023 7:20 am America/New_York

Data are posted to ladsweb and AWS almost simultaneously however we found an issue with the file transfer to AWS which is now resolved. However, it will take system sometimes to catch up. We are hoping that VNP46A2 files will be current in AWS in few days (early to mid of next week).
Regards,
LAADS User Services

To receive news from LAADS DAAC direct to your inbox, email laadsdaac-join@lists.nasa.gov with “subscribe” in the subject line.

piyush
Posts: 17
Joined: Mon Sep 28, 2020 3:29 pm America/New_York
Answers: 0

Re: Delay in publication to s3://prod-lads

by piyush » Fri May 05, 2023 6:56 pm America/New_York

Thank you for confirming that data will be available on AWS without significant delays.

piyush
Posts: 17
Joined: Mon Sep 28, 2020 3:29 pm America/New_York
Answers: 0

Re: Delay in publication to s3://prod-lads

by piyush » Tue Jun 20, 2023 9:24 pm America/New_York

Hi,
It looks like there continues to be a significant delay in publication of metadata to CMR compared to LADSWEB. Does the delay imply a publication of metadata only? Is it fine to attempt to access the granules in the bucket if we see it published to LADSWEB?

Piyush

LAADS_UserServices_M
User Services
User Services
Posts: 299
Joined: Mon Sep 30, 2019 8:33 am America/New_York
Answers: 1
Has thanked: 3 times

Re: Delay in publication to s3://prod-lads

by LAADS_UserServices_M » Wed Jun 21, 2023 11:28 am America/New_York

Yes, you should access files from the bucket if available on ladsweb.
Regards,
LAADS User Services

To receive news from LAADS DAAC direct to your inbox, email laadsdaac-join@lists.nasa.gov with “subscribe” in the subject line.

Post Reply