How to download a list of data

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
guorz
Posts: 18
Joined: Wed Apr 19, 2017 1:22 pm America/New_York
Answers: 0

How to download a list of data

by guorz » Mon Jul 17, 2017 10:42 pm America/New_York

Hi,

Now I have a list of the data name that I want to download, is there any function like submit this list and then I can get the link to download all the data at once?

Thanks!

Ruizhe

Tags:

gnwiii
Posts: 713
Joined: Fri Jan 29, 2021 5:51 pm America/New_York
Answers: 2
Has thanked: 1 time

How to download a list of data

by gnwiii » Tue Jul 18, 2017 7:38 am America/New_York

By "data name" do you mean file names like A2006167181000.L0?

There are GUI programs called download managers that accept a list of URL's, or you can use command-line programs such as wget or curl.  If you just have the
file names you can edit the list to add https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/ in front of each filename to produce a list of URL's.  If you are on
Windows, you can use the Background Intelligent Transfer Service (BITS) (French).

Note that some download managers attempt to speed up downloads by splitting files into chunks and downloading them in parallel or downloading many files at once.  NASA may block IP addresses that are too aggressively hogging bandwidth, so you may need to adjust the default configuration of download managers.

See: Topic 4658 and   Topic 3081, but note that you need to use https URL's and recent versions of wget or curl that support NASA's https servers.  Note that these examples were posted before the switch to https, so use http URL's.

Post Reply