Automated downloads using Application Keys failing since 06/01?

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
b.mccabe
Posts: 23
Joined: Mon Oct 13, 2014 1:18 pm America/New_York
Answers: 0

Automated downloads using Application Keys failing since 06/01?

by b.mccabe » Wed Jun 09, 2021 9:16 am America/New_York

The DRL regularly retrieves files from EarthData applications via automated scripts in order to meet both our needs and the needs of our user community. However, since the 1st of June, our scripts that use "Authorization: Bearer <application key>" are no longer working, and are failing with "ERROR 500: Internal Server Error" errors. Any ideas why these failures are occurring or what may be done to resolve them? Here's some examples of failed commands using wget:

Code: Select all

wget -nd -nv --header="Authorization: Bearer <application key>" https://omisips1.omisips.eosdis.nasa.gov/outgoing/OMPS/LP-DRK/ -O -
https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&client_id=VfQBP-rzjQI3CjXNjTYiqw&redirect_uri=https%3A%2F%2Fomisips1.omisips.eosdis.nasa.gov%2Fcallback&state=L291dGdvaW5nL09NUFMvTFAtRFJLLw%3D%3D%0A:
2021-06-04 16:29:16 ERROR 500: Internal Server Error.

Code: Select all

wget -nd -nv --header="Authorization: Bearer <application key>" https://ladsweb.modaps.eosdis.nasa.gov/archive/allData/61/MYDCSR_B/2021/149/MYDCSR_B.A2021149.061.2021159062223.hdf
https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&client_id=A6th7HB-3EBoO7iOCiCLlA&redirect_uri=https%3A%2F%2Fladsweb.modaps.eosdis.nasa.gov%2Fcallback&state=L2FyY2hpdmUvYWxsRGF0YS82MS9NWURDU1JfQi8yMDIxLzE0OS9NWURDU1JfQi5BMjAyMTE0OS4w%0ANjEuMjAyMTE1OTA2MjIyMy5oZGY%3D%0A:
2021-06-09 15:12:08 ERROR 500: Internal Server Error.
These two examples use different application keys, so this isn't simply a case of a single key no longer working.

Thanks,
Benjamin McCabe / DRL Computer Scientist

Tags:

OB ODPS - jgwilding
Subject Matter Expert
Subject Matter Expert
Posts: 139
Joined: Fri Feb 19, 2021 1:09 pm America/New_York
Answers: 0
Been thanked: 1 time

Re: Automated downloads using Application Keys failing since 06/01?

by OB ODPS - jgwilding » Mon Jun 14, 2021 11:11 am America/New_York

Hi. I'm actually with the OB-DAAC, but i wonder if this is your problem.


Dear LANCE-MODIS Users:

Starting 6/1/2021 we will be expiring all app keys in favor of using tokens. If you authenticate via the “Authorization: Bearer <app key>” HTTPS header and the app key you provide is formatted as XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX then the app key will stop working starting 6/1/2021. To prevent disruption in your access to data please generate a new token. You can find instructions to generate a new token at https://ladsweb.modaps.eosdis.nasa.gov/ ... ts/#tokens


Regards,
lance-modis Users Support

Post Reply