Search found 73 matches

by earthengine_urs
Wed May 13, 2020 2:27 pm America/New_York
Forum: Home
Question: New SST data in CMR?
Replies: 19

New SST data in CMR?

Tommy, We see SST files for 20200310, but now there is no SST for 20200331. Worse, if I look at CMR, there are no files for any of the concepts we care about at all starting from Mar 15 (even though your site has the files):        'C1458097478-OB_DAAC',    ...
by earthengine_urs
Mon May 11, 2020 3:43 pm America/New_York
Forum: Home
Question: New SST data in CMR?
Replies: 19

New SST data in CMR?

Thank you, Tommy. Are the files ever supposed to be missing? My current code has a provision for handling missing files, and I'm wondering is this is still relevant.
by earthengine_urs
Fri May 08, 2020 5:15 pm America/New_York
Forum: Home
Question: New SST data in CMR?
Replies: 19

New SST data in CMR?

Hi, I noticed that there is no https://oceandata.sci.gsfc.nasa.gov/ob/getfile/TERRA_MODIS.20200311.L3m.DAY.SST.sst.4km.nc (compare with the existing https://oceandata.sci.gsfc.nasa.gov/ob/getfile/TERRA_MODIS.20200310.L3m.DAY.SST.sst.4km.nc) I'm trying to use CMR to list the available files, but can'...
by earthengine_urs
Fri Apr 17, 2020 9:56 pm America/New_York
Forum: Home
Question: Issues with wget authentication
Replies: 23

Issues with wget authentication

Thank you for the pointer, gnwiii@ . I was actually going to change my custom Java code to something saner, an since the resources module works well for me, I'll just switch to Python.
by earthengine_urs
Thu Apr 16, 2020 8:49 pm America/New_York
Forum: Home
Question: Issues with wget authentication
Replies: 23

Issues with wget authentication

Sean,You are right, my issue is that I did not get this far. I'm still having authentication issues. I cannot use neither wget nor curl, so I have to do everything manually. Looking at wget's auth-no-challenge implementation, it seems all it does is set basic auth headers, which we already d...
by earthengine_urs
Fri Apr 03, 2020 1:29 pm America/New_York
Forum: Home
Question: Issues with wget authentication
Replies: 23

Issues with wget authentication

Sean,I am able to read the file listing from NASA CMR, but the lack of the file size in the HEAD request is still a problem. Our generic downloading code looks at the expected file size to make sure the download is not interrupted. I can turn this check off or propagate the known file size from else...
by earthengine_urs
Tue Feb 04, 2020 4:59 pm America/New_York
Forum: Home
Question: Issues with wget authentication
Replies: 23

Issues with wget authentication

Sean,

To make sure I get this right - what are CMD concept ids for MODIS Terra and Aqua L3BIN datasets? For example, is this the correct concept id for CHL:
https://search.earthdata.nasa.gov/search/granules?p=C1458149034-OB_DAAC&q=modis%20terra%20l3bin&tl=1565042310!4!!
by earthengine_urs
Wed Jan 29, 2020 4:56 pm America/New_York
Forum: Home
Question: Issues with wget authentication
Replies: 23

Issues with wget authentication

Thank you, these URL now work. Last question - if a file has different creation time and modification time, which of them shows up in the cdate field? (Hopefully, modification time?)
by earthengine_urs
Wed Jan 29, 2020 12:13 pm America/New_York
Forum: Home
Question: Issues with wget authentication
Replies: 23

Issues with wget authentication

Sean,

Yes, crawl-????.googlebot.com sounds right. If it's impossible to unblock it, I'll try CMR.
by earthengine_urs
Tue Jan 28, 2020 7:54 pm America/New_York
Forum: Home
Question: Issues with wget authentication
Replies: 23

Issues with wget authentication

I'm able to repeat the request with the exact same headers without issues from my desktop, so I'm kinda stumped. Could you look in nginx's error logs to see if there are any details? The URL I tried was:https://oceandata.sci.gsfc.nasa.gov/api/file_search?search=A2020014.L3m_DAY_CHL_chlor...