Unknown Error, Could not get file HEAD: HTTP Error 403: Forbidden

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
shimonhypervine
Posts: 2
Joined: Tue Dec 17, 2024 5:49 am America/New_York
Answers: 0

Unknown Error, Could not get file HEAD: HTTP Error 403: Forbidden

by shimonhypervine » Wed Dec 18, 2024 4:58 am America/New_York

When i try to download sentinel-1 data using python script for bulk download it shows:
Unknown Error, Could not get file HEAD: HTTP Error 403: Forbidden

And previously if we restart the downloads it skips the files that have been already downloaded and restarts wherever the files are partially downloaded but now if we rerun the script it just starts from initial asset and move towards the next after completing the first. It then takes a lot of time. Can someone point a solution for this issue.
Attachments
ASF.png
ASF.png (207.25 KiB) Not viewed yet

Filters:

ASF - bhauer
User Services
User Services
Posts: 16
Joined: Thu Dec 12, 2024 5:54 pm America/New_York
Answers: 0

Re: Unknown Error, Could not get file HEAD: HTTP Error 403: Forbidden

by ASF - bhauer » Thu Dec 19, 2024 3:59 pm America/New_York

This is a bug in the bulk download script that we recently became aware of and hope to have fixed soon. I'll let you know when this has happened.

Thank you for your patience.
Bill Hauer
Alaska Satellite Facility DAAC
User Support Office
uso@asf.alaska.edu

mike_chan
Posts: 1
Joined: Mon Dec 23, 2024 8:59 am America/New_York
Answers: 0

Re: Unknown Error, Could not get file HEAD: HTTP Error 403: Forbidden

by mike_chan » Mon Dec 23, 2024 9:14 am America/New_York

Hey there

I have been bothered by the same issue lately, so I rewrite the script to solve it, you can find it at:

https://github.com/chenyw-insar/bulk_downloader_asf

Remember to paste the urls inside your original script into the "urls = []" position before execute it.

Hope it helps :)
YW Chen

shimonhypervine
Posts: 2
Joined: Tue Dec 17, 2024 5:49 am America/New_York
Answers: 0

Re: Unknown Error, Could not get file HEAD: HTTP Error 403: Forbidden

by shimonhypervine » Fri Jan 10, 2025 12:24 pm America/New_York

Hi @mike_chan, Thank you for the script it works fine. Is there any update from the team regarding the issue?

ASF - bhauer
User Services
User Services
Posts: 16
Joined: Thu Dec 12, 2024 5:54 pm America/New_York
Answers: 0

Re: Unknown Error, Could not get file HEAD: HTTP Error 403: Forbidden

by ASF - bhauer » Fri Jan 10, 2025 3:06 pm America/New_York

The bug is still being worked on, and I'll let you know just as soon as we've got a fix. Thanks for your patience!
Bill Hauer
Alaska Satellite Facility DAAC
User Support Office
uso@asf.alaska.edu

radar_rob
Posts: 1
Joined: Thu Mar 20, 2025 7:40 am America/New_York
Answers: 0

Re: Unknown Error, Could not get file HEAD: HTTP Error 403: Forbidden

by radar_rob » Thu Mar 20, 2025 7:45 am America/New_York

This issue persists to this day. I was using python files downloaded from the ASF (search.asf.alaska.edu) website.

ASF - bhauer
User Services
User Services
Posts: 16
Joined: Thu Dec 12, 2024 5:54 pm America/New_York
Answers: 0

Re: Unknown Error, Could not get file HEAD: HTTP Error 403: Forbidden

by ASF - bhauer » Fri Mar 21, 2025 5:41 pm America/New_York

We hope to have a fix delivered next week. Thanks again for your patience!
Bill Hauer
Alaska Satellite Facility DAAC
User Support Office
uso@asf.alaska.edu

Post Reply