Problem getting Aqua and Terra CHL Subscription Files

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
oceani
Posts: 79
Joined: Wed Aug 23, 2006 12:32 pm America/New_York
Answers: 0
Has thanked: 2 times

Problem getting Aqua and Terra CHL Subscription Files

by oceani » Thu Feb 04, 2021 5:46 pm America/New_York

For the pas two days I have been having trouble retrieving Aqua and Terra CHL files for my subscriptions using wget.  Same wget string we have been using for many years.  Nothing on this end has changed and this is happening for several of our subscriptions. Strangely enough this only seems to be happening on one of my machines. Other machines getting MODIS SST, VIIR CHL, VIIRS SST are working fine.  The outward-facing IP address is 207.224.51.246.  I am wondering if this machine somehow got blacklist over the past few days.  Here is a snippet of the 'results'/error message we are getting for one of the download attempts.--2021-02-04 15:17:20--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/2021034175000.L2_LAC_OC.ncResolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xxx.xx.xxxConnecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xxx.xx.xxx|:443... connected.HTTP request sent, awaiting response... 302 FoundLocation: /ob/getfile/2021034175000.L2_LAC_OC.nc [following]--2021-02-04 15:17:21--  https://oceandata.sci.gsfc.nasa.gov/ob/getfile/2021034175000.L2_LAC_OC.ncReusing existing connection to oceandata.sci.gsfc.nasa.gov:443.HTTP request sent, awaiting response... 302 FoundLocation: https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fob%2Fgetfile%2Frestrict&client_id=Z0u-MdLNypXBjiDREZ3roA [following]--2021-02-04 15:17:21--  https://urs.earthdata.nasa.gov/oauth/authorize?response_type=code&redirect_uri=https%3A%2F%2Foceandata.sci.gsfc.nasa.gov%2Fob%2Fgetfile%2Frestrict&client_id=Z0u-MdLNypXBjiDREZ3roAResolving urs.earthdata.nasa.gov (urs.earthdata.nasa.gov)... 198.118.243.33, 2001:4d0:241a:4081::89Connecting to urs.earthdata.nasa.gov (urs.earthdata.nasa.gov)|198.118.243.33|:443... connected.HTTP request sent, awaiting response... 302 FoundLocation: https://oceandata.sci.gsfc.nasa.gov/ob/getfile/restrict?code=ad061056c6f8d52eee2cff8484855d79a12a4fba416c45c1fef88b308cc11726 [following]--2021-02-04 15:17:21--  https://oceandata.sci.gsfc.nasa.gov/ob/getfile/restrict?code=ad061056c6f8d52eee2cff8484855d79a12a4fba416c45c1fef88b308cc11726Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xxx.xx.xxx|:443... connected.HTTP request sent, awaiting response... 302 FoundLocation: /ob/getfile/2021034175000.L2_LAC_OC.nc [following]--2021-02-04 15:17:22--  https://oceandata.sci.gsfc.nasa.gov/ob/getfile/2021034175000.L2_LAC_OC.ncReusing existing connection to oceandata.sci.gsfc.nasa.gov:443.HTTP request sent, awaiting response... 404 Not Found2021-02-04 15:17:27 ERROR 404: Not FoundAlways ends with the ERROR 404: Not Found error.For added information the command I am using is:  wget -t 3 --user={our user name} --password={our password} --auth-no-challenge=on https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/{filenme.nc}Any help you can provide is much appreciated.-Mark

Tags:

dana.r.wilson
Posts: 71
Joined: Mon Apr 20, 2020 8:04 am America/New_York
Answers: 0

Problem getting Aqua and Terra CHL Subscription Files

by dana.r.wilson » Fri Feb 05, 2021 9:12 am America/New_York

Mark
How did you arrive at the file name 2021034175000.L2_LAC_OC.nc the correct file name for the file you are trying to download would be A2021034175000.L2_LAC_OC.nc.
Can you post your subscription id?

oceani
Posts: 79
Joined: Wed Aug 23, 2006 12:32 pm America/New_York
Answers: 0
Has thanked: 2 times

Problem getting Aqua and Terra CHL Subscription Files

by oceani » Fri Feb 05, 2021 11:05 am America/New_York

Perfect question!  You helped me solve the issue.  Either your path has change from http to https or something in those file names changed. My script was extracting the available file names from a list generated by another wget command and as of two days ago, it started missing that first character when parsing out the filename.  Not sure exactly what changed, but don't care.  Problem solved.  Thank you for your help and keen eye.

Mark

Post Reply