I am accessing HLS data in a python script using pystac_client to search the STAC and stackstac to load the data into multidimensional arrays. This morning I tried to run the process but the cloud-optimized geotiffs seem to be inaccessible now. This was working as recently as a few weeks ago.
I do not think this is a python problem since it also fails when I try to download a file via my local web browser using the href link in the STAC metadata.
For example, I should be able to navigate to this URL and download the file after providing username/password:
"https://data.lpdaac.earthdatacloud.nasa.gov/lp-prod-protected/HLSL30.020/HLS.L30.T15UXP.2022284T165821.v2.0/HLS.L30.T15UXP.2022284T165821.v2.0.Fmask.tif"
Similarly, GDAL cannot read this file anymore. This produces an error with HTTP response code: 303
gdalinfo /vsicurl/https://data.lpdaac.earthdatacloud.nasa.gov/lp-prod-protected/HLSL30.020/HLS.L30.T15UXP.2022284T165821.v2.0/HLS.L30.T15UXP.2022284T165821.v2.0.Fmask.tif
Has something changed about the storage of the HLS COGs?
Thanks for your help!
HLS tifs no longer accessible
-
LP DAACx - dgolon
- User Services
- Posts: 420
- Joined: Mon Sep 30, 2019 10:00 am America/New_York
- Has thanked: 30 times
- Been thanked: 8 times
- Contact:
Re: HLS tifs no longer accessible
Hi @hrodman1 thank you for bringing this to our attention. I'll talk to our science team and see what is causing the issue.
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
Re: HLS tifs no longer accessible
I am getting similar 403 - permission denied errors now. Is there a download limit per day or something?
-
earthengine_urs
- Posts: 80
- Joined: Mon Jan 27, 2020 10:36 am America/New_York
- Has thanked: 3 times
- Been thanked: 1 time
Re: HLS tifs no longer accessible
I'm also getting 403s for a number of Cloud-hosted datasets (not just HLS) - eg, https://data.lpdaac.earthdatacloud.nasa.gov/lp-prod-protected/MYD13Q1.061/MYD13Q1.A2023089.h31v10.061.2023107102235/MYD13Q1.A2023089.h31v10.061.2023107102235.hdf
-
LP DAACx - dgolon
- User Services
- Posts: 420
- Joined: Mon Sep 30, 2019 10:00 am America/New_York
- Has thanked: 30 times
- Been thanked: 8 times
- Contact:
Re: HLS tifs no longer accessible
Hello all. We are looking into this and will report back once the issue has been resolved.
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
-
LP DAACx - dgolon
- User Services
- Posts: 420
- Joined: Mon Sep 30, 2019 10:00 am America/New_York
- Has thanked: 30 times
- Been thanked: 8 times
- Contact:
Re: HLS tifs no longer accessible
Hello @hrodman1 , @sparajuli , @earthengine_urs I just received word from the team that this issue is now resolved. Could you please try again and let me know if you are still having issues accessing the data? Thanks!
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
Re: HLS tifs no longer accessible
I am getting this error again and have not been able to download HLS 2.0 data. Could you look over the issue?
-
LP DAACx - dgolon
- User Services
- Posts: 420
- Joined: Mon Sep 30, 2019 10:00 am America/New_York
- Has thanked: 30 times
- Been thanked: 8 times
- Contact:
Re: HLS tifs no longer accessible
Hi @sparajuli I've tried a few different HLS scenes and I am able to download them. Could you please give me an example of a link that is giving you the error?
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.
Re: HLS tifs no longer accessible
I'm seeing the same error here as well, using Python 3.9.17 and GDAL 3.5.2. I'm able to download other file types but am not receiving the TIFs -
Failed to process: '/vsicurl/https://data.lpdaac.earthdatacloud.nasa.gov/lp-prod-protected/HLSL30.020/HLS.L30.T18STE.2023267T154720.v2.0/HLS.L30.T18STE.2023267T154720.v2.0.Fmask.tif' not recognized as a supported file format.
Failed to process: '/vsicurl/https://data.lpdaac.earthdatacloud.nasa.gov/lp-prod-protected/HLSL30.020/HLS.L30.T18STE.2023267T154720.v2.0/HLS.L30.T18STE.2023267T154720.v2.0.Fmask.tif' not recognized as a supported file format.