Page 1 of 1

wget bulk download stops after downloading only 2 files

Posted: Tue Mar 07, 2023 12:39 am America/New_York
by michelleescobarcarias01
Hi,

My wget command to download MERRA-2 relative humidity data from Jan 1, 1980 to Dec 31, 2021 stops working after the second day. My command only downloads the first two lines in the text file: the MERRA2_readme.PDF and day 1 (Jan 1, 1980).
https://goldsmr5.gesdisc.eosdis.nasa.gov/daac-bin/OTF/HTTP_services.cgi?FILENAME=%2Fdata%2FMERRA2%2FM2I3NVASM.5.12.4%2F1980%2F01%2FMERRA2_100.inst3_3d_asm_Nv.19800101.nc4&BBOX=-90%2C-180%2C90%2C180&VERSION=1.02&DATASET_VERSION=5.12.4&VARIABLES=RH&FORMAT=bmM0Lw&SERVICE=L34RS_MERRA2&LABEL=MERRA2_100.inst3_3d_asm_Nv.19800101.SUB.nc&SHORTNAME=M2I3NVASM

I am attaching a pdf of the log. I would really appreciate any help since a manual download of all these files would take me forever.

Many thanks!

Michelle

Re: wget bulk download stops after downloading only 2 files

Posted: Thu Mar 09, 2023 10:14 pm America/New_York
by mgreene
Sorry for the inconvenience. We have tried to figure out the causes of your
cases. One possible reason might be "Wget/1.20.3" you are using might not work
well with downloading data from our system. Can you try a lower version, such
as "Wget/1.19" or "Wget/1.18"?

Another possible reason might be associated with the Windows system. wget is
particularly challenging for Windows users.

Would you like to try alternative ways to download data with other tools, as
below?

1. Web-based tools like TDS: How to Obtain a Spatially Subsetted Time Series
using
TDS(https://disc.gsfc.nasa.gov/information/howto?keywords=TDS&title=How%20to%20Obtain%20a%20Spatially%20Subsetted%20Time%20Series%20using%20TDS%20)?

2. API: How to Use the Web Services API for Subsetting MERRA-2 Data
(https://disc.gsfc.nasa.gov/information/howto?keywords=MERRA-2&title=How%20to%20Use%20the%20Web%20Services%20API%20for%20Subsetting%20MERRA-2%20Data)

MERRA-2 support team

Re: wget bulk download stops after downloading only 2 files

Posted: Mon Mar 13, 2023 4:44 pm America/New_York
by mgreene
Following up to see if you had any success with the previous suggestions.