TROPOMI AAI/CO Error when Downloading via shell script
-
- Posts: 4
- Joined: Tue May 30, 2023 12:01 pm America/New_York
TROPOMI AAI/CO Error when Downloading via shell script
Hi,
I have been trying to download TROPOMI data using a script (i.e. following this method: https://wiki.earthdata.nasa.gov/display/EDSC/How+To%3A+Use+the+Download+Access+Script), but I am being met with an error after a few files have downloaded (see attached screenshot). Anyone know why this is happening and/or how to fix it? I have ensured all applications are correctly authorized in my Earthdata account.
I am working on a Mac computer with macOS Ventura version 13.3.1 . Any help would really be appreciated!
I have been trying to download TROPOMI data using a script (i.e. following this method: https://wiki.earthdata.nasa.gov/display/EDSC/How+To%3A+Use+the+Download+Access+Script), but I am being met with an error after a few files have downloaded (see attached screenshot). Anyone know why this is happening and/or how to fix it? I have ensured all applications are correctly authorized in my Earthdata account.
I am working on a Mac computer with macOS Ventura version 13.3.1 . Any help would really be appreciated!
Filters:
Re: TROPOMI AAI/CO Error when Downloading via shell script
Hello,
Thank you for reporting this issue. Could you please provide the screenshot you mentioned in your post. Once we receive that our science team will take a look at what you are seeing.
Thank you for reporting this issue. Could you please provide the screenshot you mentioned in your post. Once we receive that our science team will take a look at what you are seeing.
-
- Posts: 4
- Joined: Tue May 30, 2023 12:01 pm America/New_York
Re: TROPOMI AAI/CO Error when Downloading via shell script
Apologies. I thought I had attached it the first time.
- Attachments
-
- Screenshot 2023-05-30 at 12.02.08 PM.png (71.29 KiB) Not viewed yet
-
- Subject Matter Expert
- Posts: 22
- Joined: Wed Feb 16, 2022 4:38 pm America/New_York
- Has thanked: 1 time
Re: TROPOMI AAI/CO Error when Downloading via shell script
Hello,
It was reported earlier today that there were DNS issues with some earthdata.nasa.gov domains, which may have caused this error at the time the script was run. Are you able to download the granule again, through the browser? https://data.gesdisc.earthdata.nasa.gov/data/S5P_TROPOMI_Level2/S5P_L2__CO_____HiR.2/2021/304/S5P_RPRO_L2__CO_____20211031T221021_20211031T235150_20991_03_020400_20220831T100818.nc
If not, it may be caused by a syntax error in your download script.
Chris Battisto (GES DISC)
It was reported earlier today that there were DNS issues with some earthdata.nasa.gov domains, which may have caused this error at the time the script was run. Are you able to download the granule again, through the browser? https://data.gesdisc.earthdata.nasa.gov/data/S5P_TROPOMI_Level2/S5P_L2__CO_____HiR.2/2021/304/S5P_RPRO_L2__CO_____20211031T221021_20211031T235150_20991_03_020400_20220831T100818.nc
If not, it may be caused by a syntax error in your download script.
Chris Battisto (GES DISC)
Re: TROPOMI AAI/CO Error when Downloading via shell script
Following up to see if you were able to try again and download your data of need successfully.kaganakiyama wrote: ↑Wed May 31, 2023 9:11 am America/New_York Apologies. I thought I had attached it the first time.
-
- Posts: 4
- Joined: Tue May 30, 2023 12:01 pm America/New_York
Re: TROPOMI AAI/CO Error when Downloading via shell script
Thanks for following up! I didn't edit the scripts at all from how it was formatted on the download link. Clicking the browser link did work for that one granule, but the problem is persistent for many granules. I found that downloading shell scripts for a smaller time frame does not cause the issue!
-
- Subject Matter Expert
- Posts: 22
- Joined: Wed Feb 16, 2022 4:38 pm America/New_York
- Has thanked: 1 time
Re: TROPOMI AAI/CO Error when Downloading via shell script
Could you please post the shell script here? Also, in the meantime, are you able to use the wget command to pull the files from the shell script, like so:
wget --user=myusername --password=mypassword -i 'download.sh'
wget --user=myusername --password=mypassword -i 'download.sh'
-
- Posts: 4
- Joined: Tue May 30, 2023 12:01 pm America/New_York
Re: TROPOMI AAI/CO Error when Downloading via shell script
I have tried the wget command with no luck. I end up getting similar errors.
The shell script here is for AAI in November of 2021. It is exactly as was downloaded from the Earthdata search, i.e. I did not alter anything. I will admit I am quite unfamiliar with the bash language, but I can see in the "exit with error" function, specifically line 32, that whenever there is an error it exits the loop and echoes the error I have been getting.
Hopefully there is a solution here that I am missing!
The shell script here is for AAI in November of 2021. It is exactly as was downloaded from the Earthdata search, i.e. I did not alter anything. I will admit I am quite unfamiliar with the bash language, but I can see in the "exit with error" function, specifically line 32, that whenever there is an error it exits the loop and echoes the error I have been getting.
Hopefully there is a solution here that I am missing!
- Attachments
-
- AAI_NOV_2021_03.JPG (437.58 KiB) Not viewed yet
-
- AAI_NOV_2021_02.JPG (67.92 KiB) Not viewed yet
-
- AAI_NOV_2021_01.JPG (114.99 KiB) Not viewed yet
Re: TROPOMI AAI/CO Error when Downloading via shell script
Hi, There is no known issue on our end that would give you an error. Please try again and let us know the status. Thanks
Re: TROPOMI AAI/CO Error when Downloading via shell script
kaganakiyama, Following up to see if you had a chance to try again with successful results or if you still seek our attention to this matter.