Page 1 of 2

HLS tifs no longer accessible

Posted: Tue Apr 18, 2023 9:59 am America/New_York
by hrodman1
I am accessing HLS data in a python script using pystac_client to search the STAC and stackstac to load the data into multidimensional arrays. This morning I tried to run the process but the cloud-optimized geotiffs seem to be inaccessible now. This was working as recently as a few weeks ago.

I do not think this is a python problem since it also fails when I try to download a file via my local web browser using the href link in the STAC metadata.

For example, I should be able to navigate to this URL and download the file after providing username/password:
"https://data.lpdaac.earthdatacloud.nasa.gov/lp-prod-protected/HLSL30.020/HLS.L30.T15UXP.2022284T165821.v2.0/HLS.L30.T15UXP.2022284T165821.v2.0.Fmask.tif"

Similarly, GDAL cannot read this file anymore. This produces an error with HTTP response code: 303

gdalinfo /vsicurl/https://data.lpdaac.earthdatacloud.nasa.gov/lp-prod-protected/HLSL30.020/HLS.L30.T15UXP.2022284T165821.v2.0/HLS.L30.T15UXP.2022284T165821.v2.0.Fmask.tif

Has something changed about the storage of the HLS COGs?

Thanks for your help!

Re: HLS tifs no longer accessible

Posted: Tue Apr 18, 2023 10:06 am America/New_York
by LP DAAC - dgolon
Hi @hrodman1 thank you for bringing this to our attention. I'll talk to our science team and see what is causing the issue.

Re: HLS tifs no longer accessible

Posted: Tue Apr 18, 2023 11:24 am America/New_York
by sparajuli
I am getting similar 403 - permission denied errors now. Is there a download limit per day or something?

Re: HLS tifs no longer accessible

Posted: Tue Apr 18, 2023 3:27 pm America/New_York
by earthengine_urs

Re: HLS tifs no longer accessible

Posted: Tue Apr 18, 2023 3:36 pm America/New_York
by LP DAAC - dgolon
Hello all. We are looking into this and will report back once the issue has been resolved.

Re: HLS tifs no longer accessible

Posted: Tue Apr 18, 2023 5:29 pm America/New_York
by LP DAAC - dgolon
Hello @hrodman1 , @sparajuli , @earthengine_urs I just received word from the team that this issue is now resolved. Could you please try again and let me know if you are still having issues accessing the data? Thanks!

Re: HLS tifs no longer accessible

Posted: Wed Apr 19, 2023 6:29 am America/New_York
by hrodman1
@dgolon access has been restored - thank you for your help!

Re: HLS tifs no longer accessible

Posted: Mon May 01, 2023 10:03 am America/New_York
by sparajuli
I am getting this error again and have not been able to download HLS 2.0 data. Could you look over the issue?

Re: HLS tifs no longer accessible

Posted: Tue May 02, 2023 1:41 pm America/New_York
by LP DAAC - dgolon
Hi @sparajuli I've tried a few different HLS scenes and I am able to download them. Could you please give me an example of a link that is giving you the error?

Re: HLS tifs no longer accessible

Posted: Wed Sep 27, 2023 8:06 pm America/New_York
by subbuaa
I'm seeing the same error here as well, using Python 3.9.17 and GDAL 3.5.2. I'm able to download other file types but am not receiving the TIFs -

Failed to process: '/vsicurl/https://data.lpdaac.earthdatacloud.nasa.gov/lp-prod-protected/HLSL30.020/HLS.L30.T18STE.2023267T154720.v2.0/HLS.L30.T18STE.2023267T154720.v2.0.Fmask.tif' not recognized as a supported file format.