Can't download GPM IMERG files in Windows 11 using wget
Posted: Tue Feb 14, 2023 8:53 am America/New_York
I'm getting a 'Username/Password Authentication Failed' and 'Unknown authentication scheme' error when trying to download GPM IMERG files through the OPeNDAP subsetting service using wget in Windows 11.
I've followed the 'wget for Windows' section in https://disc.gsfc.nasa.gov/data-access#windows_wget step-by-step and yet I continue to receive this error.
To start, launching cmd and making a cookies file results in a weird error. Following the steps in the above link, I use this code:
C:\Users\username\Desktop\folder>NUL > .urs_cookies
which gives me this error message:
'NUL' is not recognized as an internal or external command,
operable program or batch file.
However, the .urs_cookies file is still created and stored in the desktop folder. In fact, running the dir command in cmd (as per the instructions in this troubleshooting guide: https://daac.gsfc.nasa.gov/information/howto?title=How%20To%20resolve%20data%20download%20problems) for this folder's directory shows me that the file does exist (as a 0 byte URS_COOKIES file) and is stored in this folder.
Since the .urs_cookies file exists in the folder where I want to download the GPM IMERG files, I run the following code to download the GPM IMERG files through a .txt file with the file links (url.txt):
wget --load-cookies C:\Users\username\Desktop\folder\.urs_cookies --save-cookies C:\Users\username\Desktop\folder\.urs_cookies --auth-no-challenge=on --keep-session-cookies --user=<username> --ask-password --content-disposition -i url.txt
I'm able to download IMERG_ATBD_V06.pdf and README.GPM.pdf with no problems at all. After that however, it gives me the following error:
--2023-02-14 21:23:40-- https://gpm1.gesdisc.eosdis.nasa.gov/opendap/GPM_L3/GPM_3IMERGHH.06/2020/299/3B-HHR.MS.MRG.3IMERG.20201025-S000000-E002959.0000.V06B.HDF5.nc4?precipitationCal[0:0][3023:3045][1017:1043],lat_bnds[1017:1043][0:1],lon_bnds[3023:3045][0:1],time,lon[3023:3045],lat[1017:1043],latv,lonv
Connecting to gpm1.gesdisc.eosdis.nasa.gov (gpm1.gesdisc.eosdis.nasa.gov)|198.118.197.50|:443... connected.
HTTP request sent, awaiting response... 401 Unauthorized
Unknown authentication scheme.
Username/Password Authentication Failed.
--2023-02-14 21:23:41-- https://gpm1.gesdisc.eosdis.nasa.gov/opendap/GPM_L3/GPM_3IMERGHH.06/2020/299/3B-HHR.MS.MRG.3IMERG.20201025-S003000-E005959.0030.V06B.HDF5.nc4?precipitationCal[0:0][3023:3045][1017:1043],lat_bnds[1017:1043][0:1],lon_bnds[3023:3045][0:1],time,lon[3023:3045],lat[1017:1043],latv,lonv
Connecting to gpm1.gesdisc.eosdis.nasa.gov (gpm1.gesdisc.eosdis.nasa.gov)|198.118.197.50|:443... connected.
HTTP request sent, awaiting response... 401 Unauthorized
Unknown authentication scheme.
Username/Password Authentication Failed.
--2023-02-14 21:23:42-- https://gpm1.gesdisc.eosdis.nasa.gov/opendap/GPM_L3/GPM_3IMERGHH.06/2020/299/3B-HHR.MS.MRG.3IMERG.20201025-S010000-E012959.0060.V06B.HDF5.nc4?precipitationCal[0:0][3023:3045][1017:1043],lat_bnds[1017:1043][0:1],lon_bnds[3023:3045][0:1],time,lon[3023:3045],lat[1017:1043],latv,lonv
Connecting to gpm1.gesdisc.eosdis.nasa.gov (gpm1.gesdisc.eosdis.nasa.gov)|198.118.197.50|:443... connected.
Unable to establish SSL connection.
--2023-02-14 21:23:42-- https://gpm1.gesdisc.eosdis.nasa.gov/opendap/GPM_L3/GPM_3IMERGHH.06/2020/299/3B-HHR.MS.MRG.3IMERG.20201025-S013000-E015959.0090.V06B.HDF5.nc4?precipitationCal[0:0][3023:3045][1017:1043],lat_bnds[1017:1043][0:1],lon_bnds[3023:3045][0:1],time,lon[3023:3045],lat[1017:1043],latv,lonv
Connecting to gpm1.gesdisc.eosdis.nasa.gov (gpm1.gesdisc.eosdis.nasa.gov)|198.118.197.50|:443... connected.
HTTP request sent, awaiting response... 401 Unauthorized
Unknown authentication scheme.
I think the root of the error could be in the creation of the .urs_cookies file but I am not so sure. I really have no idea how to fix this. Any help would be appreciated.
For reference, I'm using GNU wget 1.21.3 for Windows 11. A picture of the wget info, as well as the authentication error and the parameters of the GPM IMERG files I am trying to download are attached.
I've followed the 'wget for Windows' section in https://disc.gsfc.nasa.gov/data-access#windows_wget step-by-step and yet I continue to receive this error.
To start, launching cmd and making a cookies file results in a weird error. Following the steps in the above link, I use this code:
C:\Users\username\Desktop\folder>NUL > .urs_cookies
which gives me this error message:
'NUL' is not recognized as an internal or external command,
operable program or batch file.
However, the .urs_cookies file is still created and stored in the desktop folder. In fact, running the dir command in cmd (as per the instructions in this troubleshooting guide: https://daac.gsfc.nasa.gov/information/howto?title=How%20To%20resolve%20data%20download%20problems) for this folder's directory shows me that the file does exist (as a 0 byte URS_COOKIES file) and is stored in this folder.
Since the .urs_cookies file exists in the folder where I want to download the GPM IMERG files, I run the following code to download the GPM IMERG files through a .txt file with the file links (url.txt):
wget --load-cookies C:\Users\username\Desktop\folder\.urs_cookies --save-cookies C:\Users\username\Desktop\folder\.urs_cookies --auth-no-challenge=on --keep-session-cookies --user=<username> --ask-password --content-disposition -i url.txt
I'm able to download IMERG_ATBD_V06.pdf and README.GPM.pdf with no problems at all. After that however, it gives me the following error:
--2023-02-14 21:23:40-- https://gpm1.gesdisc.eosdis.nasa.gov/opendap/GPM_L3/GPM_3IMERGHH.06/2020/299/3B-HHR.MS.MRG.3IMERG.20201025-S000000-E002959.0000.V06B.HDF5.nc4?precipitationCal[0:0][3023:3045][1017:1043],lat_bnds[1017:1043][0:1],lon_bnds[3023:3045][0:1],time,lon[3023:3045],lat[1017:1043],latv,lonv
Connecting to gpm1.gesdisc.eosdis.nasa.gov (gpm1.gesdisc.eosdis.nasa.gov)|198.118.197.50|:443... connected.
HTTP request sent, awaiting response... 401 Unauthorized
Unknown authentication scheme.
Username/Password Authentication Failed.
--2023-02-14 21:23:41-- https://gpm1.gesdisc.eosdis.nasa.gov/opendap/GPM_L3/GPM_3IMERGHH.06/2020/299/3B-HHR.MS.MRG.3IMERG.20201025-S003000-E005959.0030.V06B.HDF5.nc4?precipitationCal[0:0][3023:3045][1017:1043],lat_bnds[1017:1043][0:1],lon_bnds[3023:3045][0:1],time,lon[3023:3045],lat[1017:1043],latv,lonv
Connecting to gpm1.gesdisc.eosdis.nasa.gov (gpm1.gesdisc.eosdis.nasa.gov)|198.118.197.50|:443... connected.
HTTP request sent, awaiting response... 401 Unauthorized
Unknown authentication scheme.
Username/Password Authentication Failed.
--2023-02-14 21:23:42-- https://gpm1.gesdisc.eosdis.nasa.gov/opendap/GPM_L3/GPM_3IMERGHH.06/2020/299/3B-HHR.MS.MRG.3IMERG.20201025-S010000-E012959.0060.V06B.HDF5.nc4?precipitationCal[0:0][3023:3045][1017:1043],lat_bnds[1017:1043][0:1],lon_bnds[3023:3045][0:1],time,lon[3023:3045],lat[1017:1043],latv,lonv
Connecting to gpm1.gesdisc.eosdis.nasa.gov (gpm1.gesdisc.eosdis.nasa.gov)|198.118.197.50|:443... connected.
Unable to establish SSL connection.
--2023-02-14 21:23:42-- https://gpm1.gesdisc.eosdis.nasa.gov/opendap/GPM_L3/GPM_3IMERGHH.06/2020/299/3B-HHR.MS.MRG.3IMERG.20201025-S013000-E015959.0090.V06B.HDF5.nc4?precipitationCal[0:0][3023:3045][1017:1043],lat_bnds[1017:1043][0:1],lon_bnds[3023:3045][0:1],time,lon[3023:3045],lat[1017:1043],latv,lonv
Connecting to gpm1.gesdisc.eosdis.nasa.gov (gpm1.gesdisc.eosdis.nasa.gov)|198.118.197.50|:443... connected.
HTTP request sent, awaiting response... 401 Unauthorized
Unknown authentication scheme.
I think the root of the error could be in the creation of the .urs_cookies file but I am not so sure. I really have no idea how to fix this. Any help would be appreciated.
For reference, I'm using GNU wget 1.21.3 for Windows 11. A picture of the wget info, as well as the authentication error and the parameters of the GPM IMERG files I am trying to download are attached.