Missing files downloading GPM IMERG data

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
lorenzovergni1
Posts: 3
Joined: Mon May 30, 2022 10:00 am America/New_York
Answers: 0

Missing files downloading GPM IMERG data

by lorenzovergni1 » Mon May 30, 2022 10:34 am America/New_York

Hi,
I'm downloading GPM-IMERG half hourly data using the subset/get data tool available at the page: https://disc.gsfc.nasa.gov/datasets/GPM_3IMERGHH_06/summary

I'm using wget (version 1.21.3 built on mingw32). The procedure consists in downloading multiple files using the link file *.txt obtained. Everything seems to work fine, however for about one-half of the links included in the text file, I get the message
"Unable to establish SSL connection" and the corresponding file is not downloaded.
Can you suggest a possible solution?
Thank you
Lorenzo Vergni

Tags:

GES DISC - jimacker
User Services
User Services
Posts: 298
Joined: Mon Sep 30, 2019 1:57 pm America/New_York
Answers: 3
Has thanked: 2 times
Been thanked: 4 times

Re: Missing files downloading GPM IMERG data

by GES DISC - jimacker » Wed Jun 01, 2022 12:27 pm America/New_York

Dear Lorenzo Vergni,

I have submitted your question to our data access / download experts, and they are formulating a response.

GES DISC - mgreene
User Services
User Services
Posts: 186
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: Missing files downloading GPM IMERG data

by GES DISC - mgreene » Thu Jun 02, 2022 4:47 pm America/New_York

Dear Lorenzo Vergni,

First, make sure that some of the data files are actually being downloaded and if they are then try again.

I am also including the data access instructions in the following link.
https://disc.gsfc.nasa.gov/data-access

If you still experience an issue after trying again and reading the instructions, please contact the GES DISC Help Desk at the following email address. gsfc-dl-help-disc@mail.nasa.gov, so we can check the logs on the GPM server.

Regards,

lorenzovergni1
Posts: 3
Joined: Mon May 30, 2022 10:00 am America/New_York
Answers: 0

Re: Missing files downloading GPM IMERG data

by lorenzovergni1 » Fri Jun 03, 2022 8:39 am America/New_York

Thank you for your reply,
I tried again to download half-hourly data for january 2018. The total number of links is 1488 (48 data/day * 31 days). The download starts correctly but very often I get the message "Unable to establish SSL connection". Finally I obtained 888 files (out of 1488). I will contact the help desk as you suggested.
Best regards,
Lorenzo

GES DISC - mgreene
User Services
User Services
Posts: 186
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: Missing files downloading GPM IMERG data

by GES DISC - mgreene » Fri Jun 03, 2022 9:20 am America/New_York

Thank you

fakhry.jayousi
Posts: 1
Joined: Sat Jun 04, 2022 1:54 pm America/New_York
Answers: 0

Re: Missing files downloading GPM IMERG data

by fakhry.jayousi » Sat Jun 04, 2022 1:57 pm America/New_York

Hi,
I am facing a similar issue when downloading daily data as IMERG Final run for 20 years (7345 days). I followed the instructions correctly, however the first time i got around 4300 files and 5300 the second time.
Any updates on how to solve the issue?
Thank you

lorenzovergni1
Posts: 3
Joined: Mon May 30, 2022 10:00 am America/New_York
Answers: 0

Re: Missing files downloading GPM IMERG data

by lorenzovergni1 » Tue Jun 07, 2022 11:48 am America/New_York

Hi,
I got in touch with the help desk who proposed me some possible solutions, but they didn't work. I then tried to use wget under linux (actually via cygwin), following the specific instructions. Now it seems to work, so I guess the problem is due to some bugs of wget under Windows.
Regards
Lorenzo

GES DISC - mgreene
User Services
User Services
Posts: 186
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: Missing files downloading GPM IMERG data

by GES DISC - mgreene » Thu Jun 09, 2022 9:13 am America/New_York

Another option to try would be to use the most recent "native"-windows wget compiled with the latest SSL (https://disc.gsfc.nasa.gov/data-access#windows_wget)

Post Reply