OLCI data access

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
jstum
Posts: 83
Joined: Mon Jul 04, 2005 4:54 am America/New_York
Answers: 0
Been thanked: 1 time

OLCI data access

by jstum » Fri Apr 28, 2017 9:01 am America/New_York

Hello,

I was trying to download OLCI L1 files from your server, e.g. wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zip
But this command returns only a html file, not the actual data file. I has however modified my autentication profile (I digitally 'signed' the Sentinel data access agreement on the URS authentication site).
Is there something to do more on my side ?

Thanks

Jacques

Tags:

OB.DAAC - amscott
User Services
User Services
Posts: 350
Joined: Mon Jun 22, 2020 5:24 pm America/New_York
Answers: 1
Has thanked: 8 times
Been thanked: 3 times

OLCI data access

by OB.DAAC - amscott » Fri Apr 28, 2017 2:44 pm America/New_York

Jaques,

I was unable to duplicate your issue, but from related posts, it seems that you might need to update your software: https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?pid=28131;hl=wget

or you can attempt these wget with Earthdata login options to see if corrects your problem: https://disc.gsfc.nasa.gov/registration/registration-for-data-access#Wget

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1464
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1
Been thanked: 5 times

OLCI data access

by OB.DAAC - SeanBailey » Sat Apr 29, 2017 2:03 pm America/New_York

Did you "approve" the "OB.DAAC Sentinel" application in your EarthData Login profile?   I ask because I do not see you listed in the users who have done so...

The first time you attempt to download OLCI L1B data, you must accept the user agreement (which may be the html information you downloaded).  Try using your browser to download the file.  Or, login your EarthData account, select "My Applications", look for the "OB.DAAC Sentinel" application.  If it is not in your list of approved applications, you can add it with the "Add more applications" link.

Sean

jstum
Posts: 83
Joined: Mon Jul 04, 2005 4:54 am America/New_York
Answers: 0
Been thanked: 1 time

OLCI data access

by jstum » Thu May 04, 2017 12:23 pm America/New_York

Sean,

Following your remark, I added the "OB.DAAC Sentinel" application in my EarthData Login profile. But nothing changes, my wget command still returns and html file, not the actual OLCI file.

Jacques

gnwiii
Posts: 713
Joined: Fri Jan 29, 2021 5:51 pm America/New_York
Answers: 2
Has thanked: 1 time

OLCI data access

by gnwiii » Thu May 04, 2017 1:37 pm America/New_York

The html file may contain some hints about the problem.  Have you tried viewing it in a browser?

jstum
Posts: 83
Joined: Mon Jul 04, 2005 4:54 am America/New_York
Answers: 0
Been thanked: 1 time

OLCI data access

by jstum » Fri May 05, 2017 3:55 am America/New_York

Hi George, hereafter some more information :
1- wget a VIIRS file
2- wget an OLCI file
3- content of the html file

1- wget a VIIRS file :
wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2017124000000.GEO-M_SNPP.nc
--2017-05-05 09:46:12--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2017124000000.GEO-M_SNPP.nc
Resolving proxy-prod.cls.fr (proxy-prod.cls.fr)... xx.xxx.xx.xx
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 200 OK
Length: 55468205 (53M) [application/octet-stream]
Saving to: âV2017124000000.GEO-M_SNPP.nc.1â

V2017124000000.GEO-M_SNPP.nc.1                      100%[=================================================================================================================>]  52.90M  3.89MB/s    in 17s

2017-05-05 09:46:31 (3.07 MB/s) - âV2017124000000.GEO-M_SNPP.nc.1â saved [55468205/55468205]

2- wget an OLCI file :
wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S3A_OL_1_EFR____20170504T000013_20170504T000313_20170504T020102_0179_017_173_1980_SVL_O_NR_002.zip
--2017-05-05 09:51:14--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S3A_OL_1_EFR____20170504T000013_20170504T000313_20170504T020102_0179_017_173_1980_SVL_O_NR_002.zip
Resolving proxy-prod.cls.fr (proxy-prod.cls.fr)... xx.xxx.xx.xx
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 302 Found
Location: /sentinel/getfile/S3A_OL_1_EFR____20170504T000013_20170504T000313_20170504T020102_0179_017_173_1980_SVL_O_NR_002.zip [following]
--2017-05-05 09:51:15--  https://oceandata.sci.gsfc.nasa.gov/sentinel/getfile/S3A_OL_1_EFR____20170504T000013_20170504T000313_20170504T020102_0179_017_173_1980_SVL_O_NR_002.zip
Reusing existing connection to oceandata.sci.gsfc.nasa.gov:443.
Proxy request sent, awaiting response... 302 Found
Location: https://urs.earthdata.nasa.gov/oauth/authorize?client_id=onClX3wZwggzbKMGnT2LFg&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fsentinel%2Fgetfile%2Frestrict&response_type=code&required_scope=study_area,country [following]
--2017-05-05 09:51:16--  https://urs.earthdata.nasa.gov/oauth/authorize?client_id=onClX3wZwggzbKMGnT2LFg&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fsentinel%2Fgetfile%2Frestrict&response_type=code&required_scope=study_area,country
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: âS3A_OL_1_EFR____20170504T000013_20170504T000313_20170504T020102_0179_017_173_1980_SVL_O_NR_002.zipâ

S3A_OL_1_EFR____20170504T000013_20170504T000313_201     [ <=>                                                                                                              ]   8.74K  --.-KB/s    in 0.1s

2017-05-05 09:51:17 (59.5 KB/s) - âS3A_OL_1_EFR____20170504T000013_20170504T000313_20170504T020102_0179_017_173_1980_SVL_O_NR_002.zipâ saved [8951]

3- geany S3A_OL_1_EFR____20170504T000013_20170504T000313_20170504T020102_0179_017_173_1980_SVL_O_NR_002.zip&
With geany, hereafter is the html file :

<!DOCTYPE html>
<!--[if lt IE 7]><html class="no-js lt-ie9 lt-ie8 lt-ie7"> <![endif]-->
<!--[if IE 7]><html class="no-js lt-ie9 lt-ie8"> <![endif]-->
<!--[if IE 8]><html class="no-js lt-ie9"> <![endif]-->
<!--[if gt IE 8]><!--><html lang="en" class="no-js"><!--<![endif]-->
  <head>
    <meta charset="utf-8">
    <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
    <title>Earthdata Login</title>
    <meta name="description" content="Earthdata Login">
    <meta name="viewport" content="width=device-width, initial-scale=1.0">
    <link href="https://cdn.earthdata.nasa.gov/eui/1.1.3/stylesheets/application.css" rel="stylesheet" />
    <link rel="stylesheet" media="all" href="/assets/application-e135186db6d445d384330d03b064804c.css" />
    <!--[if IE 7]>
      <link rel="stylesheet" href="/assets/font-awesome-ie7.min.css">
    <![endif]-->
    <link href="//netdna.bootstrapcdn.com/font-awesome/4.3.0/css/font-awesome.min.css" rel="stylesheet">
    <link href='https://fonts.googleapis.com/css?family=Source+Sans+Pro:300,700' rel='stylesheet' type='text/css'>
    <meta name="csrf-param" content="authenticity_token" />
<meta name="csrf-token" content="sMZpTJCvQvB8Vz9ChoqpVK5vxh2gvbRBjiUxH30Pxh9jBUGFvQYhELZu59pQO/ABc7U/I4XQm6pTsfESMwKrYg==" />
   

    <!-- Grid background: http://subtlepatterns.com/graphy/ -->
  </head>
  <body class="oauth authorize" data-turbolinks-eval=false>
    <!-- Add the Status banner -->
    <div id="earthdata-notification-banner"></div>
    <!-- End Status banner -->
    <!--[if lt IE 7]>
      <p class="chromeframe">You are using an <strong>outdated</strong> browser. Please <a href="http://browsehappy.com/">upgrade your browser</a> or <a href="http://www.google.com/chromeframe/?redirect=true">activate Google Chrome Frame</a> to improve your experience.</p>
    <![endif]-->
    <div class="container">
      <header role="banner">
  <div id="masthead-logo">
    <h1><a class="ir" href="/">Earthdata Login</a></h1>
    <span class="eui-badge badge daac">Earthdata Login</span>
  </div>
  <a id="hamburger" href="#"><img title="Mobile Menu" alt="Three horizontal lines stacked" src="/assets/hamburger-19ec7f3abc024164ce47ffa933a09fd8.png" /></a>
  <nav role="navigation">
    <div id="hide">
      <ul>
      </ul>
    </div>
  </nav>
</header>

     

      <section id="callout-login">
  <div class="client-login">
   
    <br>
    <h3 class="client-description">
     
    </h3>

  </div>
  <form id="login" action="/login" accept-charset="UTF-8" method="post"><input name="utf8" type="hidden" value="&#x2713;" /><input type="hidden" name="authenticity_token" value="6xaBDfT7jX68ZUOXGEF2tKP+Wv924K7riTbsrvWBE7A41anE2VLunnZcmw/O8C/hfiSjwVONgQBUoiyju4x+zQ==" />
  <p><label for="username">Username</label><i class="fa fa-question-circle fa-question-circle--blue fa-question-circle--blue user-name" title="Login using either your Username or Email Address"></i><input type="text" name="username" id="username" autofocus="autofocus" class="default" /></p>
  <p><label for="password">Password</label><br /><input type="password" name="password" id="password" /></p>

  <p><input type="hidden" name="client_id" id="client_id" value="onClX3wZwggzbKMGnT2LFg" /></p>
  <p><input type="hidden" name="redirect_uri" id="redirect_uri" value="https://oceandata.sci.gsfc.nasa.gov/sentinel/getfile/restrict" /></p>      <p><input type="hidden" name="response_type" id="response_type" value="code" /></p>
      <p><input type="hidden" name="state" id="state" /></p>
        <p><input type="hidden" name="required_scope" id="required_scope" value="study_area,country" /></p>
      <p><input type="checkbox" name="stay_in" id="stay_in" value="1" checked="checked" /> <label for="stay_in">Stay signed in (this is a private workstation)</label></p>

  <p class="button-with-notes">
    <input type="submit" name="commit" value="Log in" class="eui-btn--round eui-btn--green" />
    <a class="eui-btn--round eui-btn--blue" href="/users/new?client_id=onClX3wZwggzbKMGnT2LFg&amp;redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fsentinel%2Fgetfile%2Frestrict&amp;required_scope=study_area%2Ccountry&amp;response_type=code">Register</a>
  </p>
  <p class="form-instructions">
    <em class="icon-question-sign"></em>
    <a class="" href="/retrieve_info">I don&rsquo;t remember my username</a>
    <br /><em class="icon-question-sign"></em>
    <a class="" href="/reset_passwords/new">I don&rsquo;t remember my password</a>
    <br />
    <em class="icon-question-sign"></em>
    <a href="javascript:feedback.showForm();" title = 'Need Help? Click on the Feedback button to request help'>Help</a>
  </p>
</form>
<aside class="govt-msg">
  <h3></h3>
  <p>
    The Earthdata Login provides a single mechanism for user registration and profile management for all EOSDIS system components (DAACs, Tools, Services).
    Your Earthdata login also helps the EOSDIS program better understand the usage of EOSDIS services to improve user experience through customization of tools and improvement of services.
    EOSDIS data are openly available to all and free of charge except where governed by international agreements.
  </p>
</aside>

</section>
<section id="cta">
  <h3>Get single sign-on access to all your favorite EOSDIS sites</h3>
      <a class="eui-btn--round eui-btn--blue" href="/users/new?client_id=onClX3wZwggzbKMGnT2LFg&amp;redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fsentinel%2Fgetfile%2Frestrict&amp;required_scope=study_area%2Ccountry&amp;response_type=code">Register for a Profile</a>
</section>

    </div>
    <footer role="contentinfo">
      <h3>For questions regarding the EOSDIS Earthdata Login, please contact <a href="javascript:feedback.showForm();" title="Earthdata Support form">Earthdata Support</a></h3>
      <ul>
        <li><a href="/">Earthdata Login Home</a></li>
        <li><a href="/users/new">Register</a></li>
        <li><a href="/documentation">Documentation</a></li>
        <li><a title="NASA Home" href="http://www.nasa.gov">NASA</a></li>
      </ul>
      <p>NASA Official: Stephen Berrick</p>
      <div class="govt-warning">
        <p><strong>Warning: This U.S. Government resource is for authorized use only.</strong><br />By accessing the system, you are consenting to complete monitoring with no expectation of privacy. Unauthorized access or use may subject you to disciplinary action and criminal prosecution.</p>
      </div>
    </footer>
    <script src="/assets/application-b8f1be79ccac7e85e5592f0eb962f150.js"></script>
    <script type="text/javascript" charset="utf-8">
    $(window).scroll(function(e){
      parallax();
    });
    function parallax(){
      var scrolled = $(window).scrollTop();
      $('#content').css('background-position', 'right ' + -(scrolled*0.25)+'px ');
    }
    </script>
    <script type="text/javascript" src="https://cdn.earthdata.nasa.gov/tophat/tophat.js" id="earthdata-tophat-loader"></script>
    <script type="text/javascript" src="https://fbm.earthdata.nasa.gov/for/URS4/feedback.js"></script>
    <script type="text/javascript">
      feedback.init();
    </script>
    <script type="text/javascript">
        setTimeout(function()
                {var a=document.createElement("script"); var b=document.getElementsByTagName("script")[0];
                    a.src=document.location.protocol+"//dnn506yrbagrg.cloudfront.net/pages/scripts/0013/2090.js?"+Math.floor(new Date().getTime()/3600000);
                    a.async=true;a.type="text/javascript";b.parentNode.insertBefore(a,b)}
                , 1);
    </script>

    <!-- BEGIN: Unica Page Tag -->
    <!-- Copyright 2004-2010 Unica Corporation.  All rights reserved. -->
    <script type="text/javascript" language="JavaScript" src="/ntpagetag.js"></script>
    <noscript>
      <img src="https://ws1.ems.eosdis.nasa.gov/images/ntpagetag.gif?js=0" height="1" width="1" border="0" hspace="0" vspace="0" alt="">
    </noscript>
    <!-- END: Unica Page Tag -->

    <!-- BEGIN: Status App banner -->
      <script src="https://status.earthdata.nasa.gov/assets/banner_widget.js"></script>
    <!-- END: Status App banner -->

    <!-- BEGIN: Google Analytics (URSFOUR) -->
    <script>
      (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
      (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
      m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
      })(window,document,'script','//www.google-analytics.com/analytics.js','ga');

      ga('create', 'UA-62340125-2', 'auto');
      ga('send', 'pageview');
    </script>
    <!-- END: Google Analytics Tag -->

    <!-- BEGIN: DAP Google Analytics  -->
    <script language="javascript" id="_fed_an_ua_tag" src="https://dap.digitalgov.gov/Universal-Federated-Analytics-Min.js?agency=NASA&subagency=GSFC&dclink=true"></script>
    <!-- END: DAP Google Analytics  -->

   
  </body>
</html>

your help is appreciated,

Jacques

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1464
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1
Been thanked: 5 times

OLCI data access

by OB.DAAC - SeanBailey » Fri May 05, 2017 7:17 am America/New_York

Jacques,

Download your first file using a browser.  You will likely see that you still have not agreed to the Sentinel EULA and will be presented with a form to fill out.  Do that and accept the agreement and subsequent downloads should work non-interactively with your username/password.  See item #3 on the bulk download FAQ for how to set up wget to work with EarthData login.

Sean

gnwiii
Posts: 713
Joined: Fri Jan 29, 2021 5:51 pm America/New_York
Answers: 2
Has thanked: 1 time

OLCI data access

by gnwiii » Fri May 05, 2017 7:24 am America/New_York

I don't think authentication is needed for VIIRS.  The html file is just the Earthdata Login page, so there is an authentication problem, as mentioned in Alicia Scott's post.   I can download the S3 file using a browser, but with wget I get the Earthdata login html page.

You can check that your login is working with: wget --verbose --load-cookies ~/.urs_cookies --save-cookies ~/.urs_cookies --auth-no-challenge=on --keep-session-cookies https://tads1.gesdisc.eosdis.nasa.gov/data/aqua_dprep/PM1ATTNR.003/2016/347/PM1ATTNR.P2016347.0000.003.2016347150040

jstum
Posts: 83
Joined: Mon Jul 04, 2005 4:54 am America/New_York
Answers: 0
Been thanked: 1 time

OLCI data access

by jstum » Fri May 05, 2017 8:45 am America/New_York

Sean and George,

Downloading OLCI file by clicking right on the filename from the direct data access page works
As I mentioned before, I had modified my EarthData login profile to add the Sentinel applications (see enclosed screen capture)
I tried both methods proposed at the item #3 of the link you mentioned, but they both failed :

1- first method :

wget --user="my EarthData login" --password="my EarthData password" https://oceandata.sci.gsfc.nasa.gov/echo/getfile/S3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zip
--2017-05-05 13:57:35--  https://oceandata.sci.gsfc.nasa.gov/echo/getfile/S3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zip
Resolving proxy-prod.cls.fr (proxy-prod.cls.fr)... xx.xxx.xx.xx
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 302 Found
Location: https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fecho%2Fgetfile%2Frestrict&client_id=hNX5KEIeCjXnRUidBTF0Uw&required_scope=study_area,country [following]
--2017-05-05 13:57:36--  https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fecho%2Fgetfile%2Frestrict&client_id=hNX5KEIeCjXnRUidBTF0Uw&required_scope=study_area,country
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: âS3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zipâ

S3A_OL_1_EFR____20170111T004805_20170111T005105_201     [ <=>                                                                                                              ]   8.73K  46.8KB/s    in 0.2s

2017-05-05 13:57:37 (46.8 KB/s) - âS3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zipâ saved [8939]

2- second method :

touch ~/.netrc
echo "machine urs.earthdata.nasa.gov login "my EarthData login" password "my EarthData password" > ~/.netrc
chmod 0600 ~/.netrc
touch ~/.urs_cookies
wget --load-cookies ~/.urs_cookies --save-cookies ~/.urs_cookies --keep-session-cookies https://oceandata.sci.gsfc.nasa.gov/echo/getfile/S3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zip
--2017-05-05 14:03:58--  https://oceandata.sci.gsfc.nasa.gov/echo/getfile/S3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zip
Resolving proxy-prod.cls.fr (proxy-prod.cls.fr)... xx.xxx.xx.xx
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 302 Found
Location: https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fecho%2Fgetfile%2Frestrict&client_id=hNX5KEIeCjXnRUidBTF0Uw&required_scope=study_area,country [following]
--2017-05-05 14:03:59--  https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fecho%2Fgetfile%2Frestrict&client_id=hNX5KEIeCjXnRUidBTF0Uw&required_scope=study_area,country
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: âS3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zipâ

S3A_OL_1_EFR____20170111T004805_20170111T005105_201     [ <=>                                                                                                              ]   8.73K  --.-KB/s    in 0s

2017-05-05 14:04:00 (19.5 MB/s) - âS3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zipâ saved [8939]

Finaly, the test proposed by George works fine :

wget --verbose --load-cookies ~/.urs_cookies --save-cookies ~/.urs_cookies --auth-no-challenge=on --keep-session-cookies https://tads1.gesdisc.eosdis.nasa.gov/data/aqua_dprep/PM1ATTNR.003/2016/347/PM1ATTNR.P2016347.0000.003.2016347150040
--2017-05-05 14:05:28--  https://tads1.gesdisc.eosdis.nasa.gov/data/aqua_dprep/PM1ATTNR.003/2016/347/PM1ATTNR.P2016347.0000.003.2016347150040
Resolving proxy-prod.cls.fr (proxy-prod.cls.fr)... xx.xxx.xx.xx
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 302 Found
Location: https://urs.earthdata.nasa.gov/oauth/authorize/?app_type=401&client_id=e2WVk8Pw6weeLUKZYOxvTQ&response_type=code&redirect_uri=https%3A%2F%2Ftads1.gesdisc.eosdis.nasa.gov%2Fdata-redirect&state=aHR0cHM6Ly90YWRzMS5nZXNkaXNjLmVvc2Rpcy5uYXNhLmdvdi9kYXRhL2FxdWFfZHByZXAvUE0xQVRUTlIuMDAzLzIwMTYvMzQ3L1BNMUFUVE5SLlAyMDE2MzQ3LjAwMDAuMDAzLjIwMTYzNDcxNTAwNDA [following]
--2017-05-05 14:05:29--  https://urs.earthdata.nasa.gov/oauth/authorize/?app_type=401&client_id=e2WVk8Pw6weeLUKZYOxvTQ&response_type=code&redirect_uri=https%3A%2F%2Ftads1.gesdisc.eosdis.nasa.gov%2Fdata-redirect&state=aHR0cHM6Ly90YWRzMS5nZXNkaXNjLmVvc2Rpcy5uYXNhLmdvdi9kYXRhL2FxdWFfZHByZXAvUE0xQVRUTlIuMDAzLzIwMTYvMzQ3L1BNMUFUVE5SLlAyMDE2MzQ3LjAwMDAuMDAzLjIwMTYzNDcxNTAwNDA
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 302 Found
Location: https://tads1.gesdisc.eosdis.nasa.gov/data-redirect?error=access_denied&state=aHR0cHM6Ly90YWRzMS5nZXNkaXNjLmVvc2Rpcy5uYXNhLmdvdi9kYXRhL2FxdWFfZHByZXAvUE0xQVRUTlIuMDAzLzIwMTYvMzQ3L1BNMUFUVE5SLlAyMDE2MzQ3LjAwMDAuMDAzLjIwMTYzNDcxNTAwNDA [following]
--2017-05-05 14:05:30--  https://tads1.gesdisc.eosdis.nasa.gov/data-redirect?error=access_denied&state=aHR0cHM6Ly90YWRzMS5nZXNkaXNjLmVvc2Rpcy5uYXNhLmdvdi9kYXRhL2FxdWFfZHByZXAvUE0xQVRUTlIuMDAzLzIwMTYvMzQ3L1BNMUFUVE5SLlAyMDE2MzQ3LjAwMDAuMDAzLjIwMTYzNDcxNTAwNDA
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 302 Found
Location: http://disc.sci.gsfc.nasa.gov/registration/authorizing-gesdisc-data-access-in-earthdata_login [following]
--2017-05-05 14:05:31--  http://disc.sci.gsfc.nasa.gov/registration/authorizing-gesdisc-data-access-in-earthdata_login
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 301 Moved Permanently
Location: https://disc.sci.gsfc.nasa.gov/registration/authorizing-gesdisc-data-access-in-earthdata_login [following]
--2017-05-05 14:05:31--  https://disc.sci.gsfc.nasa.gov/registration/authorizing-gesdisc-data-access-in-earthdata_login
Connecting to proxy-prod.cls.fr (proxy-prod.cls.fr)|xx.xxx.xx.xx|:8080... connected.
Proxy request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: âPM1ATTNR.P2016347.0000.003.2016347150040â

PM1ATTNR.P2016347.0000.003.2016347150040                [  <=>                                                                                                             ]  36.39K  95.2KB/s    in 0.4s

2017-05-05 14:05:33 (95.2 KB/s) - âPM1ATTNR.P2016347.0000.003.2016347150040â saved [37262]
attachment 1

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1464
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1
Been thanked: 5 times

OLCI data access

by OB.DAAC - SeanBailey » Fri May 05, 2017 9:17 am America/New_York

Hmm,
Seems wget isn't happy anymore, I'll put someone on that :)
cURL worked for me, though, using the same .netrc/.urs_cookies approach.

Try:
curl -b ~/.urs_cookies -c ~/.urs_cookies -L -n -O https://oceandata.sci.gsfc.nasa.gov/echo/getfile/S3A_OL_1_EFR____20170111T004805_20170111T005105_20170112T060801_0179_013_102_3059_LN1_O_NT_002.zip

Or in a loop:

for file in $(<some list of file URLs>);
do 
  curl  -b ~/.urs_cookies -c ~/.urs_cookies -L -n -O $file;
done;

Sean

Post Reply