Missing data in OPERA RTC

[si_nbourne]

Hi,

I am getting "Not found" errors for a specific granule from Opera-RTC: OPERA_L2_RTC-S1_T090-193301-IW2_20210314T220608Z_20250702T232449Z_S1B_30_v1.0

When I try to download the files from this item, either using the asf_search python library or ASF Vertex, I get File Not Found:
https://search.asf.alaska.edu/#/?zoom=11.598&center=-56.765,-1.223&polygon=POLYGON((-56.7596%20-1.3915,-56.4491%20-1.3915,-56.4491%20-1.1164,-56.7596%20-1.1164,-56.7596%20-1.3915))&dataset=OPERA-S1&start=2021-03-14T00:00:00Z&end=2021-03-14T23:59:59Z&resultsLoaded=true&granule=OPERA_L2_RTC-S1_T090-193301-IW2_20210314T220608Z_20250702T232449Z_S1B_30_v1.0

I have no problems downloading the adjacent bursts (T090-193300-IW2, T090-193302-IW2) or any others from a broader search in the same AOI and time period - this seems to be a one-off failure. Can you explain why this is missing, or is there any property to flag that this is "bad"?

Unfortunately for programmatic access, the asf_search.download_urls method does not seem to handle such errors where a single item is not found, yet the rest of the items found in a search can be downloaded. The only way I can see to handle this error and download available items is to loop over all the items returned in the search and download the files one-by-one, so that errors can be caught and failing items skipped. Is there any other way to batch-download a large set of files and not fail if one or more of those files is not found?

Many thanks

Nathan

[ASF - bhauer]

This does appear to be a one-off, and I'm checking with our ingest team to find out why. I'll let you know what I hear back.

The Vertex Python bulk download script option is worth trying. It generates a script based on the contents of your download queue that you then run from the command line. Files "not found" are skipped over during the download process.

[si_nbourne]

Hi Bill

Thanks for your reply. I have been doing some more testing and it appears that this is not just a one-off. Testing over a large area, approximately 1% of items returned by a search are coming back with Not Found errors when attempting to download the geotiffs. This is something we can work around of course, but hopefully this is helpful for you to know. Some examples of failing granules listed below.

Thanks again,
Nathan

OPERA_L2_RTC-S1_T098-210475-IW2_20250710T111627Z_20250714T132738Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T098-210473-IW2_20250710T111622Z_20250714T132738Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T098-210474-IW2_20250710T111625Z_20250714T132738Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T098-210473-IW3_20250710T111623Z_20250714T132738Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T105-224486-IW2_20250710T220034Z_20250714T132036Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222359-IW3_20250710T202248Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222356-IW2_20250710T202238Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222353-IW3_20250710T202231Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222359-IW2_20250710T202247Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222358-IW2_20250710T202244Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222357-IW3_20250710T202242Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222356-IW3_20250710T202239Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222355-IW3_20250710T202237Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222355-IW2_20250710T202236Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222354-IW3_20250710T202234Z_20250714T132204Z_S1A_30_v1.0
OPERA_L2_RTC-S1_T104-222352-IW3_20250710T202228Z_20250714T132204Z_S1A_30_v1.0

[ASF - bhauer]

Hi Nathan,
This is very helpful information. Thank you, and we apologize for the inconvenience this has caused. I'll let you know when we find an answer.

[ASF - bhauer]

Hi Nathan,
The reason for the error has been determined and fixed for the OPERA product you initially reported. The same fix will be applied to the list of granules you provided as well. I'll let you know when this has been done.

Thanks.