Problem with bulk downloading python script on ASF vertex

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
xitong1984
Posts: 1
Joined: Wed Mar 13, 2024 4:34 am America/New_York
Answers: 0

Problem with bulk downloading python script on ASF vertex

by xitong1984 » Wed Mar 13, 2024 4:44 am America/New_York

I got the following error message when trying to use bulk downloading python script: download-all-2024-03-13_06-03-33.py

When I run python3 download-all-2024-03-13_06-03-33.py, it gives me the error message:

> attempting to download https://urs.earthdata.nasa.gov/profile
> Reusing previous cookie jar.
URL Error (from GET): <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: EE certificate key too weak (_ssl.c:1131)>, [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: EE certificate key too weak (_ssl.c:1131), https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112650_20240222T112718_052671_065F5D_6B31.zip
IMPORTANT: Remote location may not be accepting your SSL configuration. This is a terminal error.
There was a problem downloading https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112650_20240222T112718_052671_065F5D_6B31.zip

When I added the --insecure option, the above error is gone but downloading still failed. All the downloaded files are 2250 byte but it should be several GB.

python3 download-all-2024-03-13_06-03-33.py --insecure
> attempting to download https://urs.earthdata.nasa.gov/profile
> Reusing previous cookie jar.
> 'Temporary' Redirect download @ Remote archive:
> http://1.1.1.3:80/ac_portal/proxy.html?ip=10.2.14.188&r=97&t=1710319268&c=165900968996&_FLAG=1&domain_wechat=onauthservice.com&template=default&tabs=other_oauth&vlanid=0&_ID_=0&switch_url=&url=https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112650_20240222T112718_052671_065F5D_6B31.zip&controller_type=&mac=a4-bb-6d-af-be-24&oauthsrv=Oauth
(1/72) Downloading https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112650_20240222T112718_052671_065F5D_6B31.zip
> Downloaded 2250 of 2250 bytes (100.00%)
Downloaded 2250b in 1.00secs, Average Rate: 0.00MB/sec
> 'Temporary' Redirect download @ Remote archive:
> http://1.1.1.3:80/ac_portal/proxy.html?ip=10.2.14.188&r=97&t=1710319268&c=165900968996&_FLAG=1&domain_wechat=onauthservice.com&template=default&tabs=other_oauth&vlanid=0&_ID_=0&switch_url=&url=https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112625_20240222T112652_052671_065F5D_4BD5.zip&controller_type=&mac=a4-bb-6d-af-be-24&oauthsrv=Oauth

Please help.

Tags:

ASF - bhauer
User Services
User Services
Posts: 25
Joined: Tue Dec 03, 2019 3:56 pm America/New_York
Answers: 0

Re: Problem with bulk downloading python script on ASF vertex

by ASF - bhauer » Sat Mar 23, 2024 6:15 pm America/New_York

We're not sure what exactly may be causing the file downloads to be blocked, but here are some possible reasons:
  • The plaintext "http:" is suspect and indicates that the network traffic is being manipulated.
  • You are running on a system that needs to be updated.


Would it be possible to try running the download script on a different network, like from home?

Thank you.
Bill Hauer
Alaska Satellite Facility DAAC
User Support Office
uso@asf.alaska.edu

Post Reply