ERROR @ OB.DAAC

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
yang16
Posts: 41
Joined: Wed Mar 30, 2016 8:28 am America/New_York
Answers: 0

ERROR @ OB.DAAC

by yang16 » Thu Jun 23, 2022 8:50 pm America/New_York

Dear Earthdata Forum,

When I downloaded data from URLs, e.g., https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/requested_files_42.tar?h=ocdist307&p=/data1/2030211a03b52964/requested_files, in the http_manifest.txt file yesterday, I got an error as below:
Error.jpg
Error.jpg (36.13 KiB) Not viewed yet
This error still exists now. Do you know what causes this error and when can you fix it?

Thank you in advance.
Kind regards,
Amy.

Tags:

OB ODPS - jgwilding
Subject Matter Expert
Subject Matter Expert
Posts: 139
Joined: Fri Feb 19, 2021 1:09 pm America/New_York
Answers: 0
Been thanked: 1 time

Re: ERROR @ OB.DAAC

by OB ODPS - jgwilding » Sat Jul 09, 2022 8:06 am America/New_York

Hi Amy.

This order has been staged in multiple segments over the last several weeks, with about 5500 files in each segment. The TAR file that you are trying to download, requested_files_42.tar, would have been staged as part of the first segment and has since been removed to make room for other files.

Code: Select all

Seg #  Stage Date            File Count
------------------------------------------
    1  Jun 20 2022  8:02AM   5500
    2  Jun 23 2022 11:07AM   11000
    3  Jun 26 2022  1:44PM   16500
    4  Jun 29 2022  4:26PM   22000
    5  Jul  2 2022  7:11PM   27500
    6  Jul  5 2022  9:35PM   32500

When an order is staged in segments, users are sent an email that says that part of the order is ready to download. Three days later, those files are removed, and ODPS begins staging the files for the next segment. This repeats until the order is complete.

Currently the available TAR files are from requested_files_2958.tar through requested_files_3466.tar, and downloading any of those works. So the error is caused by attempting to download a file that doesn't exist.

Did you receive those stage-notification emails for the earlier segments and download the available data during the three-day window?


john

yang16
Posts: 41
Joined: Wed Mar 30, 2016 8:28 am America/New_York
Answers: 0

Re: ERROR @ OB.DAAC

by yang16 » Sat Jul 09, 2022 8:19 am America/New_York

Dear John,

Thank you for your reply and detailed explaination. I got it.

Yes, I received a notification to download a http_manifest.txt which included many URLs to download requested orders. I could download requested orders in the first few days, and then I got that error. I think the error occurred after the three-day window.

Kind regards,
Amy.

OB ODPS - jgwilding
Subject Matter Expert
Subject Matter Expert
Posts: 139
Joined: Fri Feb 19, 2021 1:09 pm America/New_York
Answers: 0
Been thanked: 1 time

Re: ERROR @ OB.DAAC

by OB ODPS - jgwilding » Sat Jul 09, 2022 9:59 am America/New_York

Hi Amy. So where are you with the rest of the downloads? Are you able to keep up with the batches within the three-day period? If you miss any of the TAR files, we can reset the order to restage them.

john

yang16
Posts: 41
Joined: Wed Mar 30, 2016 8:28 am America/New_York
Answers: 0

Re: ERROR @ OB.DAAC

by yang16 » Sat Jul 09, 2022 10:22 am America/New_York

Hi John,

Thank you for offering the help. The thing is that I do not need those data for now.

Kind regards,
Amy.

OB ODPS - jgwilding
Subject Matter Expert
Subject Matter Expert
Posts: 139
Joined: Fri Feb 19, 2021 1:09 pm America/New_York
Answers: 0
Been thanked: 1 time

Re: ERROR @ OB.DAAC

by OB ODPS - jgwilding » Sat Jul 09, 2022 1:02 pm America/New_York

Amy,

Okay. If you do get into a bind trying to download data for a segment before it expires, you can use the Order Dashboard to extend the expiration date of an order or a segment.

john

yang16
Posts: 41
Joined: Wed Mar 30, 2016 8:28 am America/New_York
Answers: 0

Re: ERROR @ OB.DAAC

by yang16 » Sat Jul 09, 2022 7:42 pm America/New_York

Hi John,

OK, I got it. Thank you.

Kind regards,
Amy.

Post Reply