Search found 137 matches
- Sat May 02, 2020 9:09 am America/New_York
- Forum: Home
- Question: how to wget files in more than one folder
- Replies: 11
how to wget files in more than one folder
Great! Note that you can also use the file-search API from the command line (see https://oceancolor.gsfc.nasa.gov/data/download_methods/) and then chain the wget commands so that the output of the file-search wget call becomes the input to the download wget call. Basically the file-searc...
- Fri May 01, 2020 7:23 am America/New_York
- Forum: Home
- Question: how to wget files in more than one folder
- Replies: 11
how to wget files in more than one folder
How about this.Add your user name and password to the ~/.netrc file first with,echo "machine urs.earthdata.nasa.gov login YOUR-USERNAME password YOUR-PASSWD" >> ~/.netrcIf not already set correctly, change mode with, chmod 600 ~/.netrcThen run,wget --load-cookies ~/.urs_cookies --save-cook...
- Thu Apr 30, 2020 3:40 pm America/New_York
- Forum: Home
- Question: how to wget files in more than one folder
- Replies: 11
how to wget files in more than one folder
Are you giving two -i options, one with list_files.txt and one with - (stdin)? I can see that as being a conflict. I don't think you need the --base and --force-html options. Each record in the list_file.txt should have a complete URL. If not, you can regenerate the file ...
- Thu Apr 30, 2020 10:53 am America/New_York
- Forum: Home
- Question: how to wget files in more than one folder
- Replies: 11
how to wget files in more than one folder
Andre,
Have you tried using the file-search utility (https://oceandata.sci.gsfc.nasa.gov/api/file_search/) to obtain a file containing the URLs to the matching files and then giving that file to wget?
john
Have you tried using the file-search utility (https://oceandata.sci.gsfc.nasa.gov/api/file_search/) to obtain a file containing the URLs to the matching files and then giving that file to wget?
john
- Tue Mar 17, 2020 4:01 pm America/New_York
- Forum: Home
- Question: Functionality of cksum
- Replies: 3
Functionality of cksum
The checksums are for you to use on your end once you download a file. You can generate a checksum (SHA1) and verify that it matches that received from the file-search call.Generally the file-search call you are using results in output that looks like this:ace2af707de98f8a2340b7a6a2f9a513cf1f2...
- Mon Mar 16, 2020 8:09 am America/New_York
- Forum: Home
- Question: Functionality of cksum
- Replies: 3
Functionality of cksum
First, i think you want cksum=1 instead of cksums=1. The API ignores cksums=1 (at least for me) and provides me with a list of files for the subscription when i use the URL in your post.Second, are you running this from a script? From what i've seen of the Scheme missing error, it is...
- Mon Feb 17, 2020 9:45 am America/New_York
- Forum: Home
- Question: wget only downloading partial file
- Replies: 18
wget only downloading partial file
This usually indicates that an HTML file was downloaded. If you're on a Linux platform, you can try the 'file' command on the saved file. If it is HTML, you should be able to view it with a text viewer or in a browser. A lot of times this ends up being the Earthdata log...
- Sun Feb 16, 2020 10:02 pm America/New_York
- Forum: Home
- Question: CRON Job and changing file name
- Replies: 12
CRON Job and changing file name
How familiar are you with the binning and mapping processes we offer? It seems like you could bin the L2 files and then generate a single daily map product for each of your regions. The L2 files vary enough by time that trying to predict them would be difficult. If you downloaded w...
- Sun Feb 16, 2020 3:04 pm America/New_York
- Forum: Home
- Question: CRON Job and changing file name
- Replies: 12
CRON Job and changing file name
I'm not sure i understand why there is a need to try to predict part of the file name when the file_search URL gives you the actual names of the files for the subscription. Whether you get the names from the file_search or got lucky and predicted them, you would need to use the same URL to...
- Fri Feb 14, 2020 10:46 pm America/New_York
- Forum: Home
- Question: CRON Job and changing file name
- Replies: 12
CRON Job and changing file name
Eric,
If you just want the PNG files, you can add the search argument to the URL:
wget -O - "https://oceandata.sci.gsfc.nasa.gov/api/file_search?subID=3472&subType=2&results_as_file=1&search=A*.png"
john
If you just want the PNG files, you can add the search argument to the URL:
wget -O - "https://oceandata.sci.gsfc.nasa.gov/api/file_search?subID=3472&subType=2&results_as_file=1&search=A*.png"
john