Page 1 of 1
ERROR @ OB.DAAC
Posted: Thu Jun 23, 2022 8:50 pm America/New_York
by yang16
Dear Earthdata Forum,
When I downloaded data from URLs, e.g.,
https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/requested_files_42.tar?h=ocdist307&p=/data1/2030211a03b52964/requested_files, in the http_manifest.txt file yesterday, I got an error as below:
- Error.jpg (36.13 KiB) Not viewed yet
This error still exists now. Do you know what causes this error and when can you fix it?
Thank you in advance.
Kind regards,
Amy.
Re: ERROR @ OB.DAAC
Posted: Sat Jul 09, 2022 8:06 am America/New_York
by OB ODPS - jgwilding
Hi Amy.
This order has been staged in multiple segments over the last several weeks, with about 5500 files in each segment. The TAR file that you are trying to download, requested_files_42.tar, would have been staged as part of the first segment and has since been removed to make room for other files.
Code: Select all
Seg # Stage Date File Count
------------------------------------------
1 Jun 20 2022 8:02AM 5500
2 Jun 23 2022 11:07AM 11000
3 Jun 26 2022 1:44PM 16500
4 Jun 29 2022 4:26PM 22000
5 Jul 2 2022 7:11PM 27500
6 Jul 5 2022 9:35PM 32500
When an order is staged in segments, users are sent an email that says that part of the order is ready to download. Three days later, those files are removed, and ODPS begins staging the files for the next segment. This repeats until the order is complete.
Currently the available TAR files are from requested_files_2958.tar through requested_files_3466.tar, and downloading any of those works. So the error is caused by attempting to download a file that doesn't exist.
Did you receive those stage-notification emails for the earlier segments and download the available data during the three-day window?
john
Re: ERROR @ OB.DAAC
Posted: Sat Jul 09, 2022 8:19 am America/New_York
by yang16
Dear John,
Thank you for your reply and detailed explaination. I got it.
Yes, I received a notification to download a http_manifest.txt which included many URLs to download requested orders. I could download requested orders in the first few days, and then I got that error. I think the error occurred after the three-day window.
Kind regards,
Amy.
Re: ERROR @ OB.DAAC
Posted: Sat Jul 09, 2022 9:59 am America/New_York
by OB ODPS - jgwilding
Hi Amy. So where are you with the rest of the downloads? Are you able to keep up with the batches within the three-day period? If you miss any of the TAR files, we can reset the order to restage them.
john
Re: ERROR @ OB.DAAC
Posted: Sat Jul 09, 2022 10:22 am America/New_York
by yang16
Hi John,
Thank you for offering the help. The thing is that I do not need those data for now.
Kind regards,
Amy.
Re: ERROR @ OB.DAAC
Posted: Sat Jul 09, 2022 1:02 pm America/New_York
by OB ODPS - jgwilding
Amy,
Okay. If you do get into a bind trying to download data for a segment before it expires, you can use the Order Dashboard to extend the expiration date of an order or a segment.
john
Re: ERROR @ OB.DAAC
Posted: Sat Jul 09, 2022 7:42 pm America/New_York
by yang16
Hi John,
OK, I got it. Thank you.
Kind regards,
Amy.