File access problems

benj · by **benj** » Fri Dec 21, 2018 6:30 am America/New_York

Our download machine was failing to get anything from yesterday afternoon (UTC) until about half an hour ago. I thought we'd been IP-banned (I think maybe we were? IP xx.xxx.xx.xx), but now the downloads have resumed there seems to be a problem at your end? We can see the file index, but most of the files behind it are returning 404 errors, eg. https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018355074800.L2_SNPP_OC.nc. I wonder slightly if we did get IP-banned it might have been because the 404s confused our downloaders.

Anyway, if it's fixable, that'd be great! ;-)

Thanks
Ben

benj · by **benj** » Fri Dec 21, 2018 6:32 am America/New_York

Quick update, problem appears to be only with very recent files. If I pick a random file from 2015 it's fine.

by **OB ODPS - towens** » Fri Dec 21, 2018 6:41 am America/New_York

I'm able to reproduce what you are reporting. We're looking into it.
Thanks,
Tommy

benj · by **benj** » Fri Dec 21, 2018 6:49 am America/New_York

Thanks Tommy. Happy Christmas. ;)

by **OB ODPS - towens** » Fri Dec 21, 2018 9:07 am America/New_York

Looks like the web folks have it sorted out. You can retry your queries, they should work.
Sorry for the trouble.
Tommy

pgarnesson · by **pgarnesson** » Wed Jan 02, 2019 4:15 am America/New_York

Hi,
we have similar issue to get some files, for instance:
https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018225.L3m_DAY_SNPP_CHL_chlor_a_4km.nc
but is is fine with others. The problem seems linked to the file, not to the connection.
Details below:
wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018226.L3m_DAY_SNPP_CHL_chlor_a_4km.nc
converted 'https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018226.L3m_DAY_SNPP_CHL_chlor_a_4km.nc' (ANSI_X3.4-1968) -> 'https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018226.L3m_DAY_SNPP_CHL_chlor_a_4km.nc' (UTF-8)
--2019-01-02 10:12:46-- https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018226.L3m_DAY_SNPP_CHL_chlor_a_4km.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-01-02 10:12:58 ERROR 404: Not Found.

benj · by **benj** » Wed Jan 02, 2019 7:25 am America/New_York

Confirmed that we're getting the same thing again. Also the index page is coming and going - sometimes it works, sometimes we get a connection error.
I assume you guys are all taking an extended holiday courtesy of the shutdown, so I assume nothing is going to happen on this until that gets sorted out. Would be nice though!

EDIT: I should say, NRT files look OK, maybe it's recent refined things and/or ancillary that aren't behaving?

dana.r.wilson · by **dana.r.wilson** » Wed Jan 02, 2019 8:35 am America/New_York

We are having server issues this morning. The admins are working to fix the issue.

dana.r.wilson · by **dana.r.wilson** » Wed Jan 02, 2019 9:42 am America/New_York

We were having server issues this morning. The server admins have corrected the issue and you should be able to access the data.

dana.r.wilson · by **dana.r.wilson** » Wed Jan 02, 2019 9:42 am America/New_York

We were having server issues this morning. The server admins have corrected the issue and you should be able to access the data.