I got the following error message when trying to use bulk downloading python script: download-all-2024-03-13_06-03-33.py
When I run python3 download-all-2024-03-13_06-03-33.py, it gives me the error message:
> attempting to download https://urs.earthdata.nasa.gov/profile
> Reusing previous cookie jar.
URL Error (from GET): <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: EE certificate key too weak (_ssl.c:1131)>, [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: EE certificate key too weak (_ssl.c:1131), https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112650_20240222T112718_052671_065F5D_6B31.zip
IMPORTANT: Remote location may not be accepting your SSL configuration. This is a terminal error.
There was a problem downloading https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112650_20240222T112718_052671_065F5D_6B31.zip
When I added the --insecure option, the above error is gone but downloading still failed. All the downloaded files are 2250 byte but it should be several GB.
python3 download-all-2024-03-13_06-03-33.py --insecure
> attempting to download https://urs.earthdata.nasa.gov/profile
> Reusing previous cookie jar.
> 'Temporary' Redirect download @ Remote archive:
> http://1.1.1.3:80/ac_portal/proxy.html?ip=10.2.14.188&r=97&t=1710319268&c=165900968996&_FLAG=1&domain_wechat=onauthservice.com&template=default&tabs=other_oauth&vlanid=0&_ID_=0&switch_url=&url=https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112650_20240222T112718_052671_065F5D_6B31.zip&controller_type=&mac=a4-bb-6d-af-be-24&oauthsrv=Oauth
(1/72) Downloading https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112650_20240222T112718_052671_065F5D_6B31.zip
> Downloaded 2250 of 2250 bytes (100.00%)
Downloaded 2250b in 1.00secs, Average Rate: 0.00MB/sec
> 'Temporary' Redirect download @ Remote archive:
> http://1.1.1.3:80/ac_portal/proxy.html?ip=10.2.14.188&r=97&t=1710319268&c=165900968996&_FLAG=1&domain_wechat=onauthservice.com&template=default&tabs=other_oauth&vlanid=0&_ID_=0&switch_url=&url=https://datapool.asf.alaska.edu/SLC/SA/S1A_IW_SLC__1SDV_20240222T112625_20240222T112652_052671_065F5D_4BD5.zip&controller_type=&mac=a4-bb-6d-af-be-24&oauthsrv=Oauth
Please help.
Problem with bulk downloading python script on ASF vertex
-
- Posts: 1
- Joined: Wed Mar 13, 2024 4:34 am America/New_York
-
- User Services
- Posts: 26
- Joined: Tue Dec 03, 2019 3:56 pm America/New_York
Re: Problem with bulk downloading python script on ASF vertex
We're not sure what exactly may be causing the file downloads to be blocked, but here are some possible reasons:
Would it be possible to try running the download script on a different network, like from home?
Thank you.
- The " 'Temporary' Redirect download @ Remote archive:
\> http://1.1.1.3:80/ac\_portal/proxy.html?..." message seems like maybe you're behind some proxy that is "helping" and causing trouble.
- The plaintext "http:" is suspect and indicates that the network traffic is being manipulated.
- You are running on a system that needs to be updated.
Would it be possible to try running the download script on a different network, like from home?
Thank you.