Search found 72 matches
- Mon May 11, 2020 3:43 pm America/New_York
- Forum: Questions/Comments
- Question: New SST data in CMR?
- Replies: 19
New SST data in CMR?
Thank you, Tommy. Are the files ever supposed to be missing? My current code has a provision for handling missing files, and I'm wondering is this is still relevant.
- Fri May 08, 2020 5:15 pm America/New_York
- Forum: Questions/Comments
- Question: New SST data in CMR?
- Replies: 19
New SST data in CMR?
Hi, I noticed that there is no https://oceandata.sci.gsfc.nasa.gov/ob/getfile/TERRA_MODIS.20200311.L3m.DAY.SST.sst.4km.nc (compare with the existing https://oceandata.sci.gsfc.nasa.gov/ob/getfile/TERRA_MODIS.20200310.L3m.DAY.SST.sst.4km.nc) I'm trying to use CMR to list the available files, but can'...
- Fri Apr 17, 2020 9:56 pm America/New_York
- Forum: Questions/Comments
- Question: Issues with wget authentication
- Replies: 23
Issues with wget authentication
Thank you for the pointer, gnwiii@ . I was actually going to change my custom Java code to something saner, an since the resources module works well for me, I'll just switch to Python.
- Thu Apr 16, 2020 8:49 pm America/New_York
- Forum: Questions/Comments
- Question: Issues with wget authentication
- Replies: 23
Issues with wget authentication
Sean,You are right, my issue is that I did not get this far. I'm still having authentication issues. I cannot use neither wget nor curl, so I have to do everything manually. Looking at wget's auth-no-challenge implementation, it seems all it does is set basic auth headers, which we already d...
- Fri Apr 03, 2020 1:29 pm America/New_York
- Forum: Questions/Comments
- Question: Issues with wget authentication
- Replies: 23
Issues with wget authentication
Sean,I am able to read the file listing from NASA CMR, but the lack of the file size in the HEAD request is still a problem. Our generic downloading code looks at the expected file size to make sure the download is not interrupted. I can turn this check off or propagate the known file size from else...
- Tue Feb 04, 2020 4:59 pm America/New_York
- Forum: Questions/Comments
- Question: Issues with wget authentication
- Replies: 23
Issues with wget authentication
Sean,
To make sure I get this right - what are CMD concept ids for MODIS Terra and Aqua L3BIN datasets? For example, is this the correct concept id for CHL:
https://search.earthdata.nasa.gov/search/granules?p=C1458149034-OB_DAAC&q=modis%20terra%20l3bin&tl=1565042310!4!!
To make sure I get this right - what are CMD concept ids for MODIS Terra and Aqua L3BIN datasets? For example, is this the correct concept id for CHL:
https://search.earthdata.nasa.gov/search/granules?p=C1458149034-OB_DAAC&q=modis%20terra%20l3bin&tl=1565042310!4!!
- Wed Jan 29, 2020 4:56 pm America/New_York
- Forum: Questions/Comments
- Question: Issues with wget authentication
- Replies: 23
Issues with wget authentication
Thank you, these URL now work. Last question - if a file has different creation time and modification time, which of them shows up in the cdate field? (Hopefully, modification time?)
- Wed Jan 29, 2020 12:13 pm America/New_York
- Forum: Questions/Comments
- Question: Issues with wget authentication
- Replies: 23
Issues with wget authentication
Sean,
Yes, crawl-????.googlebot.com sounds right. If it's impossible to unblock it, I'll try CMR.
Yes, crawl-????.googlebot.com sounds right. If it's impossible to unblock it, I'll try CMR.
- Tue Jan 28, 2020 7:54 pm America/New_York
- Forum: Questions/Comments
- Question: Issues with wget authentication
- Replies: 23
Issues with wget authentication
I'm able to repeat the request with the exact same headers without issues from my desktop, so I'm kinda stumped. Could you look in nginx's error logs to see if there are any details? The URL I tried was:https://oceandata.sci.gsfc.nasa.gov/api/file_search?search=A2020014.L3m_DAY_CHL_chlor...
- Tue Jan 28, 2020 5:48 pm America/New_York
- Forum: Questions/Comments
- Question: Issues with wget authentication
- Replies: 23
Issues with wget authentication
Thanks, Sean. This looks promising, but I'm hitting a weird snag. Using wget on such URLs works fine, but fetching them using our internal system returns a 403 and this:<!DOCTYPE html><html lang="en-US"><head><meta http-equiv="content-type" content="text/html;charset=utf...