OLCI Data Download

[avmehta]

Hello,
  I am trying to download OLCI data from OC L1&L2 Browser. I have selected dates/geographical region and get 506 swaths. I chose 'ORDER DATA' and also selected 'Do extract my order for me' and picked Level-1 data. I submitted the order and saved the urls in a file. Should I expect any email confirmation about theorder?

I used the following wget command (I have a .netrc file):
wget --load-cookies ~/.urs_cookies --save-cookies ~/.urs_cookies --auth-no-challenge=on --keep-session-cookies --content-disposition -i geturl19.txt

I get the following error  - any suggestion?
--2020-05-30 09:43:33--  https://oceandata.sci.gsfc.nasa.gov/sentinel/getfile/S3A_OL_1_EFR____20191028T150020_20191028T150320_20191029T190924_0179_051_025_2340_LN1_O_NT_002.zip
Connecting to oceandata.sci.gsfc.nasa.gov|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&client_id=onClX3wZwggzbKMGnT2LFg&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fsentinel%2Fgetfile%2Frestrict&required_scope=study_area,country [following]
--2020-05-30 09:43:33--  https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&client_id=onClX3wZwggzbKMGnT2LFg&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fsentinel%2Fgetfile%2Frestrict&required_scope=study_area,country
Connecting to urs.earthdata.nasa.gov|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 400 Bad Request
2020-05-30 09:43:33 ERROR 400: Bad Request.

Thanks.
Amita

[dana.r.wilson]

Amita
We had some server issues this morning could you try the files again.

[avmehta]

Thanks Dana.
I tried again and I do get the SA3 zip files (which are supposed to be directories). But when I try to unzip the files I get the following message (I have posted this also):

Archive:  S3A_OL_1_EFR____20190731T150748_20190731T151048_20190801T182818_0179_047_296_2340_LN1_O_NT_002.zip
  End-of-central-directory signature not found.  Either this file is not
  a zipfile, or it constitutes one disk of a multi-part archive.  In the
  latter case the central directory and zipfile comment will be found on
  the last disk(s) of this archive.
unzip:  cannot find zipfile directory in one of S3A_OL_1_EFR____20190731T150748_20190731T151048_20190801T182818_0179_047_296_2340_LN1_O_NT_002.zip or
        S3A_OL_1_EFR____20190731T150748_20190731T151048_20190801T182818_0179_047_296_2340_LN1_O_NT_002.zip.zip, and cannot find S3A_OL_1_EFR____20190731T150748_20190731T151048_20190801T182818_0179_047_296_2340_LN1_O_NT_002.zip.ZIP, period.

Thanks for your help.
Amita

[OB.DAAC - SeanBailey]

Have you checked to make sure it's a zip file?  On Linux, use the file command, e.g.: 
file S3A_OL_1_EFR____20190731T150748_20190731T151048_20190801T182818_0179_047_296_2340_LN1_O_NT_002.zip

[avmehta]

The url list I get when I order data has flies with .zip.
  I have used L-1 S3A data before and they do come as zipped directories.
Thanks.
Amita

[OB.DAAC - SeanBailey]

Yes, but is the file you are having issues with REALLY a zip file?  Sometimes transfer issues will result in not getting what you expect.  Just because the file has the .zip extension doesn't mean it's really a zip file (or a complete zip file).  The error you are seeing when unzipping the file suggests it's either not complete (transfer issue or other corruption) or not a zip file at all.

Sean

[avmehta]

Yes, that must be so. I checked and it does not say it is a zip file! I get the following:
S3A_OL_1_EFR____20190731T150748_20190731T151048_20190801T182818_0179_047_296_2340_LN1_O_NT_002.zip: HTML document, ASCII text, with very long lines
I also looked at the direct access option - for example this link is for 31 July 2019: https://oceandata.sci.gsfc.nasa.gov/S3AOLCI/L1/2019/212/
I found the above file and I can click on it to download complete zipped directory! I think I will have to somehow get to these directories from the list of url I got from the L1&L2 Browser data order!
Thanks.
Amita

[gnwiii]

You can learn more about the reason for:
S3A_OL_1_EFR____20190731T150748_20190731T151048_20190801T182818_0179_047_296_2340_LN1_O_NT_002.zip: HTML document, ASCII text, with very long lines
by renaming the file to replace ".zip" with ".html" and viewing it in a browser.   I (too often) get "with very long lines" for the EOSDIS login page when wget misbehaves.   Sean posted a python download script that is more reliable for me than wget.