Error 503 when bulk-downloading merra-2 using wget

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
victorpozsgay
Posts: 2
Joined: Tue Jul 02, 2024 12:54 pm America/New_York
Answers: 0

Error 503 when bulk-downloading merra-2 using wget

by victorpozsgay » Tue Jul 02, 2024 1:06 pm America/New_York

Hello,

In the past, I have been able to bulk-download Merra-2 data for decades using the command 'wget' without any issues (except for a few missing files but that was easily fixed with a second targeted download). However, I tried to download data from 1980 to the end of 1999 last week and a significant number of files were not downloaded, instead, I received the error message:
'Error 503: Service unavailable'

Here is an example of a link to data that could not be downloaded:
'https://goldsmr4.gesdisc.eosdis.nasa.gov/opendap/MERRA2/M2I1NXASM.5.12.4/1980/01/MERRA2_100.inst1_2d_asm_Nx.19800101.nc4.nc4?T2M[0:23][260:270][351:358],V2M[0:23][260:270][351:358],V10M[0:23][260:270][351:358],U2M[0:23][260:270][351:358],U10M[0:23][260:270][351:358],QV2M[0:23][260:270][351:358],lon[351:358],lat[260:270],time[0:23]'

I tried again this week, but I got the same issue.
Could you please let me know if something is going on with the website or if there's a way to get around this error?

Thank you very much for your time!
Best,
Victor

Filters:

victorpozsgay
Posts: 2
Joined: Tue Jul 02, 2024 12:54 pm America/New_York
Answers: 0

Re: Error 503 when bulk-downloading merra-2 using wget

by victorpozsgay » Tue Jul 02, 2024 3:33 pm America/New_York

I just wanted to add that among the hundreds of errors I mentioned above, there are also a few
'Error 500: 500'.

GES DISC-EDL - jimacker
Posts: 354
Joined: Mon Sep 30, 2019 1:57 pm America/New_York
Answers: 3
Endorsed: 9 times

Re: Error 503 when bulk-downloading merra-2 using wget

by GES DISC-EDL - jimacker » Fri Jul 05, 2024 1:20 pm America/New_York

Hello - our staff will address your MERRA-2 file download problem, but due to staff absences during the July 4 holiday week, we will evaluate the difficulty you describe in the following work week (commencing July 8).

GES DISC-EDL - ezamkoff
Posts: 17
Joined: Wed Jul 03, 2024 7:48 am America/New_York
Answers: 0

Re: Error 503 when bulk-downloading merra-2 using wget

by GES DISC-EDL - ezamkoff » Mon Jul 08, 2024 7:18 am America/New_York

Thank you for your interest in using MERRA-2 data.
Could you please try your request again and let us know if it works for you.
If you still receive an error after trying again you may want to consider
the following, if you need most variables in a MERRA2 file, please just
download the original file and avoid subsetting.
Downloading original file is much faster. Subsetting many variables requires
lots of resources and may cause data server hanging. If you really need to
subset many variables, please do it in several requests. Each request just
subsets a few variables.

Post Reply