TROPOMI AAI/CO Error when Downloading via shell script

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
kaganakiyama
Posts: 4
Joined: Tue May 30, 2023 12:01 pm America/New_York
Answers: 0

TROPOMI AAI/CO Error when Downloading via shell script

by kaganakiyama » Tue May 30, 2023 12:11 pm America/New_York

Hi,

I have been trying to download TROPOMI data using a script (i.e. following this method: https://wiki.earthdata.nasa.gov/display/EDSC/How+To%3A+Use+the+Download+Access+Script), but I am being met with an error after a few files have downloaded (see attached screenshot). Anyone know why this is happening and/or how to fix it? I have ensured all applications are correctly authorized in my Earthdata account.

I am working on a Mac computer with macOS Ventura version 13.3.1 . Any help would really be appreciated!

Tags:

GES DISC - mgreene
User Services
User Services
Posts: 176
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: TROPOMI AAI/CO Error when Downloading via shell script

by GES DISC - mgreene » Wed May 31, 2023 9:07 am America/New_York

Hello,
Thank you for reporting this issue. Could you please provide the screenshot you mentioned in your post. Once we receive that our science team will take a look at what you are seeing.

kaganakiyama
Posts: 4
Joined: Tue May 30, 2023 12:01 pm America/New_York
Answers: 0

Re: TROPOMI AAI/CO Error when Downloading via shell script

by kaganakiyama » Wed May 31, 2023 9:11 am America/New_York

Apologies. I thought I had attached it the first time.
Attachments
Screenshot 2023-05-30 at 12.02.08 PM.png
Screenshot 2023-05-30 at 12.02.08 PM.png (71.29 KiB) Not viewed yet

cbattisto
Posts: 10
Joined: Wed Feb 16, 2022 4:38 pm America/New_York
Answers: 0

Re: TROPOMI AAI/CO Error when Downloading via shell script

by cbattisto » Wed May 31, 2023 12:09 pm America/New_York

Hello,

It was reported earlier today that there were DNS issues with some earthdata.nasa.gov domains, which may have caused this error at the time the script was run. Are you able to download the granule again, through the browser? https://data.gesdisc.earthdata.nasa.gov/data/S5P_TROPOMI_Level2/S5P_L2__CO_____HiR.2/2021/304/S5P_RPRO_L2__CO_____20211031T221021_20211031T235150_20991_03_020400_20220831T100818.nc

If not, it may be caused by a syntax error in your download script.

Chris Battisto (GES DISC)

GES DISC - mgreene
User Services
User Services
Posts: 176
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: TROPOMI AAI/CO Error when Downloading via shell script

by GES DISC - mgreene » Thu Jun 08, 2023 3:24 pm America/New_York

kaganakiyama wrote: Wed May 31, 2023 9:11 am America/New_York Apologies. I thought I had attached it the first time.
Following up to see if you were able to try again and download your data of need successfully.

kaganakiyama
Posts: 4
Joined: Tue May 30, 2023 12:01 pm America/New_York
Answers: 0

Re: TROPOMI AAI/CO Error when Downloading via shell script

by kaganakiyama » Thu Jun 08, 2023 3:30 pm America/New_York

Thanks for following up! I didn't edit the scripts at all from how it was formatted on the download link. Clicking the browser link did work for that one granule, but the problem is persistent for many granules. I found that downloading shell scripts for a smaller time frame does not cause the issue!

cbattisto
Posts: 10
Joined: Wed Feb 16, 2022 4:38 pm America/New_York
Answers: 0

Re: TROPOMI AAI/CO Error when Downloading via shell script

by cbattisto » Thu Jun 08, 2023 4:33 pm America/New_York

Could you please post the shell script here? Also, in the meantime, are you able to use the wget command to pull the files from the shell script, like so:

wget --user=myusername --password=mypassword -i 'download.sh'

kaganakiyama
Posts: 4
Joined: Tue May 30, 2023 12:01 pm America/New_York
Answers: 0

Re: TROPOMI AAI/CO Error when Downloading via shell script

by kaganakiyama » Tue Jun 13, 2023 11:05 am America/New_York

I have tried the wget command with no luck. I end up getting similar errors.

The shell script here is for AAI in November of 2021. It is exactly as was downloaded from the Earthdata search, i.e. I did not alter anything. I will admit I am quite unfamiliar with the bash language, but I can see in the "exit with error" function, specifically line 32, that whenever there is an error it exits the loop and echoes the error I have been getting.

Hopefully there is a solution here that I am missing!
Attachments
AAI_NOV_2021_03.JPG
AAI_NOV_2021_03.JPG (437.58 KiB) Not viewed yet
AAI_NOV_2021_02.JPG
AAI_NOV_2021_02.JPG (67.92 KiB) Not viewed yet
AAI_NOV_2021_01.JPG
AAI_NOV_2021_01.JPG (114.99 KiB) Not viewed yet

GES DISC - mgreene
User Services
User Services
Posts: 176
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: TROPOMI AAI/CO Error when Downloading via shell script

by GES DISC - mgreene » Fri Jun 16, 2023 3:02 pm America/New_York

Hi, There is no known issue on our end that would give you an error. Please try again and let us know the status. Thanks

GES DISC - mgreene
User Services
User Services
Posts: 176
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: TROPOMI AAI/CO Error when Downloading via shell script

by GES DISC - mgreene » Wed Jun 21, 2023 2:34 pm America/New_York

kaganakiyama, Following up to see if you had a chance to try again with successful results or if you still seek our attention to this matter.

Post Reply