Page 1 of 1

TROPOMI AAI/CO Error when Downloading via shell script

Posted: Tue May 30, 2023 12:11 pm America/New_York
by kaganakiyama
Hi,

I have been trying to download TROPOMI data using a script (i.e. following this method: https://wiki.earthdata.nasa.gov/display/EDSC/How+To%3A+Use+the+Download+Access+Script), but I am being met with an error after a few files have downloaded (see attached screenshot). Anyone know why this is happening and/or how to fix it? I have ensured all applications are correctly authorized in my Earthdata account.

I am working on a Mac computer with macOS Ventura version 13.3.1 . Any help would really be appreciated!

Re: TROPOMI AAI/CO Error when Downloading via shell script

Posted: Wed May 31, 2023 9:07 am America/New_York
by GES DISC - mgreene
Hello,
Thank you for reporting this issue. Could you please provide the screenshot you mentioned in your post. Once we receive that our science team will take a look at what you are seeing.

Re: TROPOMI AAI/CO Error when Downloading via shell script

Posted: Wed May 31, 2023 9:11 am America/New_York
by kaganakiyama
Apologies. I thought I had attached it the first time.

Re: TROPOMI AAI/CO Error when Downloading via shell script

Posted: Wed May 31, 2023 12:09 pm America/New_York
by cbattisto
Hello,

It was reported earlier today that there were DNS issues with some earthdata.nasa.gov domains, which may have caused this error at the time the script was run. Are you able to download the granule again, through the browser? https://data.gesdisc.earthdata.nasa.gov/data/S5P_TROPOMI_Level2/S5P_L2__CO_____HiR.2/2021/304/S5P_RPRO_L2__CO_____20211031T221021_20211031T235150_20991_03_020400_20220831T100818.nc

If not, it may be caused by a syntax error in your download script.

Chris Battisto (GES DISC)

Re: TROPOMI AAI/CO Error when Downloading via shell script

Posted: Thu Jun 08, 2023 3:24 pm America/New_York
by GES DISC - mgreene
kaganakiyama wrote: Wed May 31, 2023 9:11 am America/New_York Apologies. I thought I had attached it the first time.
Following up to see if you were able to try again and download your data of need successfully.

Re: TROPOMI AAI/CO Error when Downloading via shell script

Posted: Thu Jun 08, 2023 3:30 pm America/New_York
by kaganakiyama
Thanks for following up! I didn't edit the scripts at all from how it was formatted on the download link. Clicking the browser link did work for that one granule, but the problem is persistent for many granules. I found that downloading shell scripts for a smaller time frame does not cause the issue!

Re: TROPOMI AAI/CO Error when Downloading via shell script

Posted: Thu Jun 08, 2023 4:33 pm America/New_York
by cbattisto
Could you please post the shell script here? Also, in the meantime, are you able to use the wget command to pull the files from the shell script, like so:

wget --user=myusername --password=mypassword -i 'download.sh'

Re: TROPOMI AAI/CO Error when Downloading via shell script

Posted: Tue Jun 13, 2023 11:05 am America/New_York
by kaganakiyama
I have tried the wget command with no luck. I end up getting similar errors.

The shell script here is for AAI in November of 2021. It is exactly as was downloaded from the Earthdata search, i.e. I did not alter anything. I will admit I am quite unfamiliar with the bash language, but I can see in the "exit with error" function, specifically line 32, that whenever there is an error it exits the loop and echoes the error I have been getting.

Hopefully there is a solution here that I am missing!

Re: TROPOMI AAI/CO Error when Downloading via shell script

Posted: Fri Jun 16, 2023 3:02 pm America/New_York
by GES DISC - mgreene
Hi, There is no known issue on our end that would give you an error. Please try again and let us know the status. Thanks

Re: TROPOMI AAI/CO Error when Downloading via shell script

Posted: Wed Jun 21, 2023 2:34 pm America/New_York
by GES DISC - mgreene
kaganakiyama, Following up to see if you had a chance to try again with successful results or if you still seek our attention to this matter.