getfile problem

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
oo_processing
Posts: 304
Joined: Wed Apr 06, 2005 12:11 pm America/New_York
Answers: 0
Has thanked: 6 times

getfile problem

by oo_processing » Thu Oct 24, 2019 10:28 pm America/New_York

Seems to be file related:
what 126 :/optics1/home1/oo_processing> wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0305_1.PDS
--2019-10-24 22:25:08--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0305_1.PDS
Resolving oceandata.sci.gsfc.nasa.gov... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 272937057 (260M) [application/octet-stream]
Saving to: “MOD00.P2003275.0305_1.PDS”

100%[====================================================================================================>] 272,937,057 18.9M/s   in 12s

2019-10-24 22:25:24 (20.8 MB/s) - “MOD00.P2003275.0305_1.PDS” saved [272937057/272937057]
what 127 :/optics1/home1/oo_processing> rm MOD00.P2003275.0305_1.PDS
what 128 :/optics1/home1/oo_processing> wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0220_1.PDS
--2019-10-24 22:26:22--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0220_1.PDS
Resolving oceandata.sci.gsfc.nasa.gov... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 242598664 (231M) [application/octet-stream]
Saving to: “MOD00.P2003275.0220_1.PDS”

100%[====================================================================================================>] 242,598,664 19.6M/s   in 10s

2019-10-24 22:26:35 (22.2 MB/s) - “MOD00.P2003275.0220_1.PDS” saved [242598664/242598664]

what 129 :/optics1/home1/oo_processing> wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0235_1.PDS
--2019-10-24 22:26:44--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0235_1.PDS
Resolving oceandata.sci.gsfc.nasa.gov... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-10-24 22:26:49 ERROR 404: Not Found.

Tags:

schckngs
Posts: 30
Joined: Wed Feb 03, 2021 1:43 pm America/New_York
Answers: 0
Has thanked: 1 time

getfile problem

by schckngs » Fri Oct 25, 2019 8:45 am America/New_York

Agreed, trying the same files (from Nova Scotia) from oo_processing's post:
1. wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0305_1.PDS
--2019-10-25 09:13:24--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0305_1.PDS
Resolving oceandata.sci.gsfc.nasa.gov... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 272937057 (260M) [application/octet-stream]
Saving to: 'MOD00.P2003275.0305_1.PDS'

2. wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0220_1.PDS
--2019-10-25 09:14:41--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0220_1.PDS
Resolving oceandata.sci.gsfc.nasa.gov... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 242598664 (231M) [application/octet-stream]
Saving to: 'MOD00.P2003275.0220_1.PDS'

3. wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0235_1.PDS
--2019-10-25 09:15:13--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/MOD00.P2003275.0235_1.PDS
Resolving oceandata.sci.gsfc.nasa.gov... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-10-25 09:15:19 ERROR 404: Not Found.


I am trying to download ancillary meteorological data for processing using POLYMER and some files fail while others do not. E.g.:
2016-257: wget -nv https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201625700_O3_AURAOMI_24h.hdf
https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201625700_O3_AURAOMI_24h.hdf:
2019-10-25 09:01:13 ERROR 404: Not Found.
wget -nv https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201625700_O3_TOMSOMI_24h.hdf
https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201625700_O3_TOMSOMI_24h.hdf:
2019-10-25 09:01:19 ERROR 404: Not Found.
wget -nv https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S20162570025723_TOAST.OZONE
https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S20162570025723_TOAST.OZONE:
2019-10-25 09:01:24 ERROR 404: Not Found.
wget -nv https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S20162570025723_TOVS.OZONE
https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S20162570025723_TOVS.OZONE:
2019-10-25 09:01:30 ERROR 404: Not Found.

2017-219: wget -nv https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201721900_O3_AURAOMI_24h.hdf
https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201721900_O3_AURAOMI_24h.hdf:
2019-10-25 09:36:16 ERROR 404: Not Found.
wget -nv https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201721900_O3_TOMSOMI_24h.hdf
https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201721900_O3_TOMSOMI_24h.hdf:
2019-10-25 09:36:22 ERROR 404: Not Found.
wget -nv https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S20172190021923_TOAST.OZONE
2019-10-25 09:36:23 URL:https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/S20172190021923_TOAST.OZONE [162082/162082] -> "ANCILLARY/METEO/2017/219/S20172190021923_TOAST.OZONE.tmp"
wget -nv https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201721912_MET_NCEPR2_6h.hdf.bz2 ...
2019-10-25 09:36:23 URL:https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201721912_MET_NCEPR2_6h.hdf.bz2 [856173/856173] -> "ANCILLARY/METEO/2017/219/N201721912_MET_NCEPR2_6h.hdf.bz2.tmp"
wget -nv https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201721918_MET_NCEPR2_6h.hdf.bz2 ...
2019-10-25 09:36:25 URL:https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N201721918_MET_NCEPR2_6h.hdf.bz2 [856271/856271] -> "ANCILLARY/METEO/2017/219/N201721918_MET_NCEPR2_6h.hdf.bz2.tmp"

oo_processing
Posts: 304
Joined: Wed Apr 06, 2005 12:11 pm America/New_York
Answers: 0
Has thanked: 6 times

getfile problem

by oo_processing » Fri Oct 25, 2019 4:06 pm America/New_York

Seems to be working now.
But I don't see a confirmation here that the issues have all been resolved.
Have all the issues been resolved?

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1469
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1
Been thanked: 5 times

getfile problem

by OB.DAAC - SeanBailey » Fri Oct 25, 2019 5:47 pm America/New_York

Resolved, well, that depends on your perspective:wink: 
We have a solution in place until we can correct the problem that cropped up this week.  So, should be OK for now, but no, I wouldn't say it's resolved, but as a user, you can :grin:...I hope...:eek:

Sean

Post Reply