Our 3 subscriptions have expired

Please enter here to ask a question about any NASA Science related topics!
adybbroe
Posts: 24
Joined: Tue Mar 20, 2012 4:43 pm America/New_York

Our 3 subscriptions have expired

by adybbroe » Thu Jul 16, 2020 4:54 pm America/New_York

Hi,

We have three subscriptions for Ocean Color data from MODIS and VIIRS over the Baltic Sea. But they all expired by end of 2019.
It concerns subscription IDs 2253 (VIIRS data - BAWS_NewBaltic) 1527 (Aqua MODIS) and 2113 (Terra MODIS).
Could we have these re-opened until end 2021?

I believe the subscriptions belong to Jörgen Öberg, a colleague at SMHI. He is in holiday right now though. Will he need to send his endorsement?

Best regards
Adam

Tags:

OB ODPS - jgwilding
Subject Matter Expert
Subject Matter Expert
Posts: 110
Joined: Fri Feb 19, 2021 1:09 pm America/New_York

Our 3 subscriptions have expired

by OB ODPS - jgwilding » Thu Jul 16, 2020 5:06 pm America/New_York

Adam,

The three subscriptions have been re-enabled, with stop date set to 2022-01-01.  I also issued the reconfirmation for them, which is good until 2020-12-30.  About 15 days prior to that time, an email will be sent to the owner's email address with a notification of the expiring confirmation and instructions on how to reconfirm them.  If you want to change the ownership of the subscriptions, that can be arranged.

Regards,
john

adybbroe
Posts: 24
Joined: Tue Mar 20, 2012 4:43 pm America/New_York

Our 3 subscriptions have expired

by adybbroe » Fri Jul 17, 2020 2:24 am America/New_York

Great, many thanks for the quick and positive response!
-Adam

adybbroe
Posts: 24
Joined: Tue Mar 20, 2012 4:43 pm America/New_York

Our 3 subscriptions have expired

by adybbroe » Fri Jul 17, 2020 2:53 am America/New_York

I am running the download script we had running last year but get a "Connection timeout" and no data downloaded.
This is the bash command:

wget -q -N -i --no-if-modified-since --post-data="subID=2253&subType=2&addurl=1&results_as_file=1&sdate=`date --date="yesterday" +"%Y-%m-%d"`" -O - h
ttps://oceandata.sci.gsfc.nasa.gov/api/file_search | wget -N -i -


The output is this:


--2020-07-17 06:37:51--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2020198121200.L1B_SNPP.S2253.nc.BAWS_NewBaltic.TC.png
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: /ob/getfile/V2020198121200.L1B_SNPP.S2253.nc.BAWS_NewBaltic.TC.png [following]
--2020-07-17 06:37:52--  https://oceandata.sci.gsfc.nasa.gov/ob/getfile/V2020198121200.L1B_SNPP.S2253.nc.BAWS_NewBaltic.TC.png
Reusing existing connection to oceandata.sci.gsfc.nasa.gov:443.
HTTP request sent, awaiting response... 302 Found
Location: https://urs.earthdata.nasa.gov/oauth/authorize?redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fob%2Fgetfile%2Frestrict&client_id=Z0u-MdLNypXBjiDREZ3roA&response_type=code [following]
--2020-07-17 06:37:52--  https://urs.earthdata.nasa.gov/oauth/authorize?redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fob%2Fgetfile%2Frestrict&client_id=Z0u-MdLNypXBjiDREZ3roA&response_type=code
Resolving urs.earthdata.nasa.gov (urs.earthdata.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:241a:4081::89
Connecting to urs.earthdata.nasa.gov (urs.earthdata.nasa.gov)|xx.xxx.xx.xx|:443... failed: Connection timed out.
Connecting to urs.earthdata.nasa.gov (urs.earthdata.nasa.gov)|2001:4d0:241a:4081::89|:443... failed: Network is unreachable.
--2020-07-17 06:39:59--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2020198121200.L2_SNPP.S2253.nc.BAWS_NewBaltic.Rrs_410.png
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 302 Found
Location: /ob/getfile/V2020198121200.L2_SNPP.S2253.nc.BAWS_NewBaltic.Rrs_410.png [following]
--2020-07-17 06:40:00--  https://oceandata.sci.gsfc.nasa.gov/ob/getfile/V2020198121200.L2_SNPP.S2253.nc.BAWS_NewBaltic.Rrs_410.png

...



Do you know what could be wrong?

Best regards
Adam

adybbroe
Posts: 24
Joined: Tue Mar 20, 2012 4:43 pm America/New_York

Our 3 subscriptions have expired

by adybbroe » Fri Jul 17, 2020 4:43 am America/New_York

Hi (again)

Okay, seems like it had to do with our firewall. I think you changed IP-adresses since last year, and our firewall need to be configured to allow traffic towards new URLs/IP-adresses.

I tried from my laptop-client and there I can get access to the data.

HOWEVER, something is still not right. The data I get are rubbish. All files have the same (small) size, see image attached. And checking one of the png's gives this strange result:


%> file V2020198121200.L2_SNPP.S2253.nc.BAWS_NewBaltic.chlor_a.png
V2020198121200.L2_SNPP.S2253.nc.BAWS_NewBaltic.chlor_a.png: HTML document, ASCII text, with very long lines


What am I possibly doing wrong?

-Adam

gnwiii
Posts: 641
Joined: Fri Jan 29, 2021 5:51 pm America/New_York
Answers: 2

Our 3 subscriptions have expired

by gnwiii » Fri Jul 17, 2020 6:35 am America/New_York

You can view the html file in a browser (change extension to .html).  Chances are it will be a login page for either urs.earthdata.nasa.gov or oceandata.sci.gsfc.nasa.gov so  ~/.netrc may need entries for two machines:

% cat ~/.netrc
machine urs.earthdata.nasa.gov
        login <login>
        password <password>
machine oceandata.sci.gsfc.nasa.gov
        login <same_login>
        password <same_password>


Updated documentation now has a python script that has been more reliable for me than either wget or curl.

adybbroe
Posts: 24
Joined: Tue Mar 20, 2012 4:43 pm America/New_York

Our 3 subscriptions have expired

by adybbroe » Fri Jul 17, 2020 8:19 am America/New_York

Ok, thanks!

I don't get the statement "You can view the html file in a browser (change extension to .html)." sorry.
I tried doing what you said with a few of the above, but the pages doesn't exist.

Concerning the password thing, I wonder how we did before. We didn't use login previously as far as I can see. Nothing in our .netrc file. Could it be that the data fetch became protected at some stage during the last year? Something we have missed?

Would it be the same login/password for both the sites?

And should my credentials I am using for being logged in to this forum work?

Sorry for all the questions!
-Adam

adybbroe
Posts: 24
Joined: Tue Mar 20, 2012 4:43 pm America/New_York

Our 3 subscriptions have expired

by adybbroe » Fri Jul 17, 2020 8:31 am America/New_York

Sorry, I get it now.
The data files I have downloaded is html code, yes. I can view that. Thanks.

-Adam

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1220
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1

Our 3 subscriptions have expired

by OB.DAAC - SeanBailey » Fri Jul 17, 2020 8:57 am America/New_York

Adam,

The requirement for an account with Earthdata Login was implemented in January of this year.

Yes, it is the same login credentials you use to access this forum.  Certain clients seem to behave better with the credentials set in the .netrc for both urs.earthdata.nasa.gov and oceandata.sci.gsfc.nasa.gov, but the former is all that should be required as oceandata is using urs.earthdata to do the authentication.

Regards,
Sean

adybbroe
Posts: 24
Joined: Tue Mar 20, 2012 4:43 pm America/New_York

Our 3 subscriptions have expired

by adybbroe » Fri Jul 17, 2020 9:24 am America/New_York

Sean,

All right, that sounds fine.

But with the credentials set in my .netrc file I still don't succeed.

I got the wget command recommended by you or some of your colleagues a while back. Is that still good?


wget -q -N -i --no-if-modified-since --post-data="subID=2253&subType=2&addurl=1&results_as_file=1&sdate=`date --date="yesterday" +"%Y-%m-%d"`" -O - https://oceandata.sci.gsfc.nasa.gov/api/file_search | wget -N -i -


I also tried:


wget -q -N -i --no-if-modified-since --auth-no-challenge=on --post-data="subID=2253&subType=2&addurl=1&results_as_file=1&sdate=`date --date="yesterday" +"%Y-%m-%d"`" -O - https://oceandata.sci.gsfc.nasa.gov/api/file_search | wget -N -i -


-Adam

Post Reply