Forum

Got it, thanks. Yes, we heeded that advice then - these batch curl commands were/are immediately preceded by a command to delete the cookie file (in the example above, > rm ~/.urs_cookies3, with that specific file only used once for downloads during any given time). As such, the cookie file is creat...

Good info, thanks. For inode considerations, probably easiest for us to just regularly purge NRT att/eph files.
-brian

[this perhaps belongs here: https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?pid=55068, but I was hesitant to post to a month old thread]Regarding the error:curl: (47) Maximum (50) redirects followedWe've been wrestling with this for a month or so, whereby our downloads fail after a s...

@john: yes, these are still returned in search (reaffirming Sean's statement):> modis_atteph.py -d -s 2012204145500 -m aquaatt1=/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2012/204/PM1ATTNR_NRT.A2012204.1450.005 att2=/shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2012/20...

I've found a really large number of MERIS FRS granules for which data in the northern Gulf of Mexico appear to be missing, or for some reason L2GEN can't process correctly from L1B. An example: M2010113155108. The first screenshot below is of the oceancolor website for this granule. The chlo...

One (hopefully helpful) note about cURL downloads:The "data downloads methods" page (https://oceancolor.gsfc.nasa.gov/data/download_methods/) says that "cURL has no method for downloading a list of URLs (although it can download multiple URLs on the command line)." While the page...

Similar issues here with downloads using curl. These worked yesterday (with UN/PW), but not today:>curl -u UN:PW --retry 5 --retry-delay 2 --max-time 0 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/A2002335084000.L0_LAC.bz2[no stdout, no file]Side note: the call as above (using ~/.netrc and ~/.urs...

Thanks, Sean. Can confirm this works on our end now, too.

Thanks Sean and George. Until you're able to resolve this on your end, we can modify our processing stream to check for 2 att (or eph) files returning from modis_atteph.py. In such instances, we'll use the one with the higher version number in the modis_GEO.py call.

Perhaps related to this post, but perhaps not...https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?tid=10951For the last ~2 weeks, we've had intermittent failures with modis_GEO.py. The program takes a LONG time to run (2-8 hours, depending on the computer), and eventually returns:P...