As an example I used the following command to access ancillary data:
/usr/bin/wget --load-cookies ~/.urs_cookies --save-cookies ~/.urs_cookies --auth-no-challenge=on --content-disposition https://oceandata.sci.gsfc.nasa.gov/cgi ... 0.0400.003 -v -d
URI encoding = âUTF-8â
Converted file name 'PM1ATTNR.P2021070.0400.003' (UTF-8) -> 'PM1ATTNR.P2021070.0400.003' (UTF-8)
--2021-03-22 08:27:43-- https://oceandata.sci.gsfc.nasa.gov/cgi ... 0.0400.003
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... 126.96.36.199, 2001:4d0:2418:128::84
Caching oceandata.sci.gsfc.nasa.gov => 188.8.131.52 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|184.108.40.206|:443... connected.
Created socket 3.
Releasing 0x0000000001cbdf50 (new refcount 1).
Initiating SSL handshake.
SSL handshake timed out.
Closed fd 3
Unable to establish SSL connection.
Saving cookies to /home/centos/.urs_cookies.
Done saving cookies.
Any suggestions would be greatly appreciated.
- User Services
- Posts: 334
- Joined: Mon Jun 22, 2020 5:24 pm America/New_York
- Has thanked: 8 times
- Been thanked: 3 times
Did you follow the steps to create a .netrc file before running your command?
When I tried your command before creating the .netrc file, I get a similar error to the one you described. Once I set up my .netrc file correctly, then ran the command, the ancillary data downloaded.
Here is the link with instructions: https://oceancolor.gsfc.nasa.gov/data/d ... wnload_sec
Over the last 4 months we have continued to have the same problem and no matter what server (and IP address) we use within the AWS Asia Pacific (Sydney) region they all get blocked. When we have done tests from our own on premise servers we have no problem and we have had success from the AWS US East (N. Virginia) us-east-1 and Asia Pacific (Tokyo) ap-northeast-1 regions. So it just seems that there is a blacklist applied to any IP addreses originating from within the AWS Asia Pacific (Sydney) ap-southeast-2 region. If I could provide the 2 IP addresses that belong to the servers we use to do the downloads would it be possible to check whether they are on your blacklist and remove them?
- User Services
- Posts: 1437
- Joined: Wed Sep 18, 2019 6:15 pm America/New_York
- Been thanked: 1 time
Please send an email to firstname.lastname@example.org with as much information as possible to describe your connection issues. Some things that might be helpful:
- The date and time you last attempted to access the site
- The IP network address of your system.
You may also want to verify that we see you as that address by visiting an IP-checking website:
- Output from a traceroute command (on Windows use tracert)