Page 1 of 2

Client Error Unauthorized for GPM_3IMERGHHE

Posted: Fri Feb 03, 2023 9:22 am America/New_York
by eletronpricing
We are having problems trying to access data from GPM_L3 IMERG files via python requests at AWS, and until yesterday the script worked with our username and password. Locally we are able to download the files without problems.

Have there been any changes to accessing OpenNDAP from python requests?

Thank you!

Re: Client Error Unauthorized for GPM_3IMERGHHE

Posted: Fri Feb 03, 2023 5:31 pm America/New_York
by GES DISC - mgreene
Hello, There was downtime in the system at the time you try your request that we believe may have been the cause for you to receive the error.
https://disc.gsfc.nasa.gov/information/alerts?title=Critical%20System%20Maintenance%20for%20Cloud%20Archive

Please try your request again and let us know if it works for you, if you receive an error please send detailed description. thanks

Re: Client Error Unauthorized for GPM_3IMERGHHE

Posted: Tue Feb 07, 2023 5:23 am America/New_York
by jmargetts
Hello,

I can confirm I'm still receiving this error using python, has a fix been found?

Thank you!

Re: Client Error Unauthorized for GPM_3IMERGHHE

Posted: Tue Feb 07, 2023 5:33 am America/New_York
by jmargetts
Just to add more information:

1) I can also go on the website, manually enter my username and password and successfully download data but this fails with the same username and password when using python code I've been using for the past couple of years to do this

2) seems to have started from the 1st of february

Re: Client Error Unauthorized for GPM_3IMERGHHE

Posted: Tue Feb 07, 2023 12:42 pm America/New_York
by GES DISC - mgreene
This file was archived on time on February 4, and is downloadable using wget and curl. Please try with simple wget and curl access to make sure you use and forward authentication your Earthdata credentials correctly. Data access instruction https://disc.gsfc.nasa.gov/data-access

Re: Client Error Unauthorized for GPM_3IMERGHHE

Posted: Wed Feb 08, 2023 11:07 am America/New_York
by jmargetts
Will access from now on only be available using wget? I've tried the other methods to retrieve the data on https://disc.gsfc.nasa.gov/data-access for both python and R but keep getting the same 401 error, thank you!

Re: Client Error Unauthorized for GPM_3IMERGHHE

Posted: Wed Feb 08, 2023 2:37 pm America/New_York
by GES DISC - mgreene
User jmargetts may we suggest to switch to Python 3 and try again.

Re: Client Error Unauthorized for GPM_3IMERGHHE

Posted: Fri Feb 10, 2023 9:50 am America/New_York
by jmargetts
Hello,

Thanks for getting back to me. I am using python 3 and the same code and python version (packages haven't changed either) that I have been using for roughly 6 months to download the data. However since the start of February I have been unable to use this method to download data due to the 401 error. I've tried it through R also and receive the same error. Is this due to the maintenance at the start of the month perhaps?

Re: Client Error Unauthorized for GPM_3IMERGHHE

Posted: Fri Feb 10, 2023 3:47 pm America/New_York
by accuweather_data_partnerships
We also are having the same problem. We are using an managed file transfer service (GoAnywhere MFT) to connect to OpenNDAP via HTTPS and download the data. This process has been working for almost a year now, but started failing with "HTTP/1.1 401 Unauthorized" around the same time as mentioned.

Re: Client Error Unauthorized for GPM_3IMERGHHE

Posted: Fri Feb 10, 2023 4:19 pm America/New_York
by GES DISC - mgreene
User jmargetts,
It seems like you were using Python 2.28. We see you have successful downloads using wget, however you should acquire wget 1.18, as recommended in:
https://disc.gsfc.nasa.gov/data-access
Also, there shouldn't be attempting simultaneous downloads.