It is impossible this afternoon to download these files using wget (no problem before). The message output is "20 redirections exceeded"I checked my profile : I have the rights.I have seen the same problem mentioned on the forum (e.g., https://oceancolor.gsfc.nasa.gov/forum/ ... irections)
I also tried clicking on the filename on the Direct Data Access web page, but it also fails for the same reasonIs it temporary? What can I do? Thank you for your help,
P.S. : my wget command is :
wget $options_wget $line, with options_wget=" --progress=bar:force -np -c -R -S --timeout=120 -t 2 --user $USER --password $PASSWORD --auth-no-challenge=on", and line="https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/$file",
$file=S3B_OL_1_EFR____20190106T151821_20190106T152121_20200111T122801_0180_020_296_2880_MR1_R_NT_002.zip using $file=A2020004003000.L2_LAC_OC.nc works well, in fact it seems that only Sentinel-3 failsI tried with all missions (VIIRS, MODIS,Aquarius, OCTS, GOCI, etc...), it works fine excepted for Sentinel-3 and HICO (but maybe for HICO I don't have the rights)
If you have accepted the Sentinel 3 EULA (you can verify by looking at your Earthdata Login profile), it's quite odd that it works for all but Sentinel-3
(and HICO - which should work as well, as there isn't a special EULA for it, it just requires an active Earthdata Login account).
I was able to replicate your redirect error, but if I replace "cgi" with "ob" it worked. When we added the requirement for authentication for all data, we redirected cgi to ob, for sentinel products that is redirected to "sentinel" (because of the required EULA). So, either replace cgi with ob (for all downloads), but use sentinel for the Sentinel-3 files.
If you use the python script (obdaac_download) we provide (available with SeaDAS or from https://oceancolor.gsfc.nasa.gov/data/download_methods/) you can skip a lot of the silliness required by wget...all it requires is the requests module and a .netrc file with your EDL credentials.
Well, cgi/getfile worked well for OLCI in the past days. Now, its doesn't work anymore, I replaced cgi by ob as you suggested and it works, thank you. For VIIRS, cgi/getfile is still functioning well
- Subject Matter Expert
- Posts: 47
- Joined: Mon Apr 20, 2020 8:04 am America/New_York
Thanks. I was able to grab all my sentinel files returned as HTML now.
Except for this one:
$ curl -b .urs_cookies_single -c .urs_cookies_single -L -n --interface 2607:fe50:0:6330::104 --retry 5 --retry-delay 2 --max-time 0 --output ./S3A_OL_1_EFR____20210203T024335_20210203T024635_20210203T043623_0179_068_089_2340_MAR_O_NR_002.zip https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S3A_OL_1_EFR____20210203T024335_20210203T024635_20210203T043623_0179_068_089_2340_MAR_O_NR_002.zip
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
102 716 102 716 0 0 129 0 0:00:05 0:00:05 --:--:-- 171
[bmurch@optics0 034]$ cat ./S3A_OL_1_EFR____20210203T024335_20210203T024635_20210203T043623_0179_068_089_2340_MAR_O_NR_002.zip
<title>ERROR @ OceanColor Biology Processing Group (OBPG)</title>
<meta name='viewport' content='width=device-width, initial-scale=1'>
<body link=white vlink=white alink=white style='background-color:#1C4960; color:white; font-size:175%'>
<hr color= #666699>
<b>.:. ERROR .:.</b>
<h2>OceanColor Biology Processing Group (OBPG)</h2>
<blockquote>We are sorry, but an error has occurred. Please use the back button to return to the previous page</blockquote>
<hr color= #666699>
<!-- IE needs 512+ bytes: http://blogs.msdn.com/b/ieinternals/archive/2010/08/19/http-error-pages-in-internet-explorer.aspx -->