Data order segment

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
emaure
Posts: 27
Joined: Tue Mar 26, 2013 7:18 am America/New_York
Answers: 0

Data order segment

by emaure » Tue Aug 14, 2018 3:54 am America/New_York

Hi,

I have been having an issue with the L2 data order system.
As I am ordering a full mission of L2 OC dataset, say VIIRS, the data volume is huge so the system partition the staged files.
After a certain # of files is staged, e.g., 20%, I am required to download them to continue the staging of other files.

To expedite this process, I am offered two options,
1. reply the notification email adding to the message body "action=delete"
2. Delete the downloaded data directly in the ODPS Dashboard

The problem is that, whenever I do the above, the order is completely deleted from my dashboard, I mean including the files to be staged.
So, after 1 or 2 above I get two emails. The 1st gives the expected information:
"Data segment has been removed and the system will begin staging the files for the next segment of your order". However, a second immediately follows informing that the "Data order has been removed from the staging system"

After this, I have to place a new order again.

Is this an ordinary event or I am missing something in here?

Thanks in advance for your kind help!
Eligio

Tags:

OB ODPS - towens
Subject Matter Expert
Subject Matter Expert
Posts: 372
Joined: Fri Feb 05, 2021 9:17 am America/New_York
Answers: 0
Been thanked: 4 times

Data order segment

by OB ODPS - towens » Tue Aug 14, 2018 7:45 am America/New_York

This is not the intended result of using the delete command for the partially filled order.
Until I am able to get this sorted with the web developers, your best bet is allow the the order to cycle through the partial staging without you giving the delete command.
The next batch of files will generate a new email when they are staged for download.
Sorry for the trouble,
Tommy

OB ODPS - jgwilding
Subject Matter Expert
Subject Matter Expert
Posts: 139
Joined: Fri Feb 19, 2021 1:09 pm America/New_York
Answers: 0
Been thanked: 1 time

Data order segment

by OB ODPS - jgwilding » Tue Aug 14, 2018 8:15 am America/New_York

Eligio,

Can you provide an order ID for me to look at?

john

OB ODPS - jgwilding
Subject Matter Expert
Subject Matter Expert
Posts: 139
Joined: Fri Feb 19, 2021 1:09 pm America/New_York
Answers: 0
Been thanked: 1 time

Data order segment

by OB ODPS - jgwilding » Tue Aug 14, 2018 9:27 am America/New_York

Eligio,

Thanks to your easy-to-match email address, i have found these old orders for you that had partially staged segments:

oid              receive_date            notify_date             expire_request_date   
---------------- ----------------------- ----------------------- -----------------------
608070f0047ab951 2018-08-12 23:14:37.070 2018-08-12 23:31:07.903 2018-08-13 02:59:23.646
40d00030137eb650 2018-08-13 03:19:24.010 2018-08-13 03:47:39.463 2018-08-13 23:21:34.350
a05080f0047fbc53 2018-08-12 23:19:37.110 2018-08-13 01:03:36.676 2018-08-14 04:06:08.370


When you expedite the expiration of a staged segment, the order manager removes the files from the staged segment, and the next batch of files get staged.  That actually occurs automatically after 3 days if you do not expedite the segment expiration.  You have these three partially staged orders currently:

oid              receive_date            notify_date             expire_request_date   
---------------- ----------------------- ----------------------- -----------------------
8060f0802176b35a 2018-08-14 04:15:03.596 2018-08-14 05:02:20.493                    NULL
a010e0802076b258 2018-08-14 04:10:33.546 2018-08-14 04:49:32.940                    NULL
90701090217eb051 2018-08-14 04:25:35.260 2018-08-14 05:15:04.250                    NULL


If you have downloaded the files for those orders, you should be able to use the dashboard to expire the current segment and have the next batch of files staged.  You might still receive email stating that the segment expired and files were removed, but those should just apply to the segment not the entire order.

john

emaure
Posts: 27
Joined: Tue Mar 26, 2013 7:18 am America/New_York
Answers: 0

Data order segment

by emaure » Tue Aug 14, 2018 8:04 pm America/New_York

Hi John,

Thanks for your reply.

Yes, these are the orders I had/have. The old orders were completely removed after requesting expedition.
So, again, I have asked the system to remove my staged files and proceed with (expedite) the staging of queued files.
However, the problems persist.
I still get two emails, one about the deletion of the segment (expected) followed by another about complete order removal (unexpected).

As your response followed that of Tommy, I believed the problem was resolved.
Thank you

Regards,
Eligio

Post Reply