Downloads returning HTML files

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
oo_processing
Posts: 307
Joined: Wed Apr 06, 2005 12:11 pm America/New_York
Answers: 0
Has thanked: 6 times

Downloads returning HTML files

by oo_processing » Tue Jun 02, 2020 11:11 am America/New_York

I have been getting d/l errors with these files all coming back as html (on two separate systems) since 1:14 today (I'm attaching a full log)

ll /shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2020/149/ | grep 665
-rw-rw-r-- 1 bmurch cms_optics     665 Jun  2 01:14 PM1ATTNR.P2020149.0000.003
-rw-rw-r-- 1 bmurch cms_optics     665 Jun  2 01:14 PM1ATTNR.P2020149.0400.003
-rw-rw-r-- 1 bmurch cms_optics     665 Jun  2 01:14 PM1ATTNR.P2020149.0600.003

And on one system these:
ll /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/15?/* | grep 665
-rw-rw-rw- 1 oo_processing oo_processing     665 Jun  2 01:42 /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015006_MET_NCEPR2_6h.hdf
-rw-rw-rw- 1 oo_processing oo_processing     665 Jun  2 01:42 /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf
-rw-rw-rw- 1 oo_processing oo_processing     665 Jun  2 00:19 /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/153/AM1ATTN0.A2020153.2000.002
AND I redownloaded these just now:

ll /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/149/ | grep 665
-rw-rw-r-- 1 oo_processing oo_processing    665 Jun  2 10:54 /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/149/PM1ATTNR.P2020149.0000.003
-rw-rw-r-- 1 oo_processing oo_processing    665 Jun  2 10:54 /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/149/PM1ATTNR.P2020149.0400.003
-rw-rw-r-- 1 oo_processing oo_processing    665 Jun  2 10:55 /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/149/PM1ATTNR.P2020149.0600.003

curl -b .urs_cookies_single -c .urs_cookies_single -L -n --retry 5 --retry-delay 2 --max-time 0 --output /shares/cms_optics/apps/seadas/seadas-7.5.3/ocssw/var/anc/2020/149/PM1ATTNR.P2020149.0000.003 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/PM1ATTNR.P2020149.0000.003
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
110   665  110   665    0     0     52      0  0:00:12  0:00:12 --:--:--   145

AND

curl -b .urs_cookies_single -c .urs_cookies_single -L -n --retry 5 --retry-delay 2 --max-time 0  --output /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/149/PM1ATTNR.P2020149.0600.003 https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/PM1ATTNR.P2020149.0600.003
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   665  100   665    0     0     53      0  0:00:12  0:00:12 --:--:--   184
attachment 1

Filters:

oo_processing
Posts: 307
Joined: Wed Apr 06, 2005 12:11 pm America/New_York
Answers: 0
Has thanked: 6 times

Downloads returning HTML files

by oo_processing » Tue Jun 02, 2020 11:29 am America/New_York

I was able to get one to come down, but it was bz2 compressed without indication in the name:

curl -b .urs_cookies_single -c .urs_cookies_single -L -n --retry 5 --retry-delay 2 --max-time 0 --verbose --output /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/N202015018_MET_NCEPR2_6h.hdf
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current                                      
                                 Dload  Upload   Total   Spent    Left  Speed                                        
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* About to connect() to oceandata.sci.gsfc.nasa.gov port 443 (#0)
*100  829k  100  829k    0     0   408k      0  0:00:02  0:00:02 --:--:-- 4167k                                                                                

file /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf
/optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf: bzip2 compressed data, block size = 100k                                                                                                        

searobin 217 :/optics1/virtual_ant/S4P_ROI_H5/seadas_l1a_geo_extract_h5> bunzip2 /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf
bunzip2: Can't guess original name for /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf -- using /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf.out
searobin 218 :/optics1/virtual_ant/S4P_ROI_H5/seadas_l1a_geo_extract_h5> mv /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf.out /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf
searobin 219 :/optics1/virtual_ant/S4P_ROI_H5/seadas_l1a_geo_extract_h5> file /optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf
/optics1/software/seadas/seadas-7.5.3/ocssw/var/anc/2020/150/N202015018_MET_NCEPR2_6h.hdf: Hierarchical Data Format (version 4) data

OB.DAAC - SeanBailey
User Services
User Services
Posts: 1474
Joined: Wed Sep 18, 2019 6:15 pm America/New_York
Answers: 1
Been thanked: 5 times

Downloads returning HTML files

by OB.DAAC - SeanBailey » Tue Jun 02, 2020 11:38 am America/New_York


Post Reply