Page 1 of 1

Error 503 when bulk-downloading merra-2 using wget

Posted: Tue Jul 02, 2024 1:06 pm America/New_York
by victorpozsgay
Hello,

In the past, I have been able to bulk-download Merra-2 data for decades using the command 'wget' without any issues (except for a few missing files but that was easily fixed with a second targeted download). However, I tried to download data from 1980 to the end of 1999 last week and a significant number of files were not downloaded, instead, I received the error message:
'Error 503: Service unavailable'

Here is an example of a link to data that could not be downloaded:
'https://goldsmr4.gesdisc.eosdis.nasa.gov/opendap/MERRA2/M2I1NXASM.5.12.4/1980/01/MERRA2_100.inst1_2d_asm_Nx.19800101.nc4.nc4?T2M[0:23][260:270][351:358],V2M[0:23][260:270][351:358],V10M[0:23][260:270][351:358],U2M[0:23][260:270][351:358],U10M[0:23][260:270][351:358],QV2M[0:23][260:270][351:358],lon[351:358],lat[260:270],time[0:23]'

I tried again this week, but I got the same issue.
Could you please let me know if something is going on with the website or if there's a way to get around this error?

Thank you very much for your time!
Best,
Victor

Re: Error 503 when bulk-downloading merra-2 using wget

Posted: Tue Jul 02, 2024 3:33 pm America/New_York
by victorpozsgay
I just wanted to add that among the hundreds of errors I mentioned above, there are also a few
'Error 500: 500'.

Re: Error 503 when bulk-downloading merra-2 using wget

Posted: Fri Jul 05, 2024 1:20 pm America/New_York
by GES DISC-EDL - jimacker
Hello - our staff will address your MERRA-2 file download problem, but due to staff absences during the July 4 holiday week, we will evaluate the difficulty you describe in the following work week (commencing July 8).

Re: Error 503 when bulk-downloading merra-2 using wget

Posted: Mon Jul 08, 2024 7:18 am America/New_York
by GES DISC-EDL - ezamkoff
Thank you for your interest in using MERRA-2 data.
Could you please try your request again and let us know if it works for you.
If you still receive an error after trying again you may want to consider
the following, if you need most variables in a MERRA2 file, please just
download the original file and avoid subsetting.
Downloading original file is much faster. Subsetting many variables requires
lots of resources and may cause data server hanging. If you really need to
subset many variables, please do it in several requests. Each request just
subsets a few variables.