wget bulk download stops after downloading only 2 files

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
michelleescobarcarias01
Posts: 4
Joined: Mon Mar 06, 2023 9:17 pm America/New_York
Answers: 0

wget bulk download stops after downloading only 2 files

by michelleescobarcarias01 » Tue Mar 07, 2023 12:39 am America/New_York

Hi,

My wget command to download MERRA-2 relative humidity data from Jan 1, 1980 to Dec 31, 2021 stops working after the second day. My command only downloads the first two lines in the text file: the MERRA2_readme.PDF and day 1 (Jan 1, 1980).
https://goldsmr5.gesdisc.eosdis.nasa.gov/daac-bin/OTF/HTTP_services.cgi?FILENAME=%2Fdata%2FMERRA2%2FM2I3NVASM.5.12.4%2F1980%2F01%2FMERRA2_100.inst3_3d_asm_Nv.19800101.nc4&BBOX=-90%2C-180%2C90%2C180&VERSION=1.02&DATASET_VERSION=5.12.4&VARIABLES=RH&FORMAT=bmM0Lw&SERVICE=L34RS_MERRA2&LABEL=MERRA2_100.inst3_3d_asm_Nv.19800101.SUB.nc&SHORTNAME=M2I3NVASM

I am attaching a pdf of the log. I would really appreciate any help since a manual download of all these files would take me forever.

Many thanks!

Michelle
Attachments
wget_log.pdf
(5.25 KiB) Downloaded 61 times

Tags:

GES DISC - mgreene
User Services
User Services
Posts: 191
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: wget bulk download stops after downloading only 2 files

by GES DISC - mgreene » Thu Mar 09, 2023 10:14 pm America/New_York

Sorry for the inconvenience. We have tried to figure out the causes of your
cases. One possible reason might be "Wget/1.20.3" you are using might not work
well with downloading data from our system. Can you try a lower version, such
as "Wget/1.19" or "Wget/1.18"?

Another possible reason might be associated with the Windows system. wget is
particularly challenging for Windows users.

Would you like to try alternative ways to download data with other tools, as
below?

1. Web-based tools like TDS: How to Obtain a Spatially Subsetted Time Series
using
TDS(https://disc.gsfc.nasa.gov/information/howto?keywords=TDS&title=How%20to%20Obtain%20a%20Spatially%20Subsetted%20Time%20Series%20using%20TDS%20)?

2. API: How to Use the Web Services API for Subsetting MERRA-2 Data
(https://disc.gsfc.nasa.gov/information/howto?keywords=MERRA-2&title=How%20to%20Use%20the%20Web%20Services%20API%20for%20Subsetting%20MERRA-2%20Data)

MERRA-2 support team

GES DISC - mgreene
User Services
User Services
Posts: 191
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: wget bulk download stops after downloading only 2 files

by GES DISC - mgreene » Mon Mar 13, 2023 4:44 pm America/New_York

Following up to see if you had any success with the previous suggestions.

Post Reply