File access problems

Please enter here to ask a question about any NASA Science related topics!
benj
Posts: 22
Joined: Fri Jun 18, 2010 8:30 am America/New_York

File access problems

by benj » Fri Dec 21, 2018 6:30 am America/New_York

Our download machine was failing to get anything from yesterday afternoon (UTC) until about half an hour ago. I thought we'd been IP-banned (I think maybe we were? IP xx.xxx.xx.xx), but now the downloads have resumed there seems to be a problem at your end? We can see the file index, but most of the files behind it are returning 404 errors, eg. https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018355074800.L2_SNPP_OC.nc. I wonder slightly if we did get IP-banned it might have been because the 404s confused our downloaders.

Anyway, if it's fixable, that'd be great! ;-)

Thanks
Ben

Tags:

benj
Posts: 22
Joined: Fri Jun 18, 2010 8:30 am America/New_York

File access problems

by benj » Fri Dec 21, 2018 6:32 am America/New_York

Quick update, problem appears to be only with very recent files. If I pick a random file from 2015 it's fine.

OB ODPS - towens
Subject Matter Expert
Subject Matter Expert
Posts: 166
Joined: Fri Feb 05, 2021 9:17 am America/New_York

File access problems

by OB ODPS - towens » Fri Dec 21, 2018 6:41 am America/New_York

I'm able to reproduce what you are reporting. We're looking into it.
Thanks,
Tommy

benj
Posts: 22
Joined: Fri Jun 18, 2010 8:30 am America/New_York

File access problems

by benj » Fri Dec 21, 2018 6:49 am America/New_York

Thanks Tommy. Happy Christmas. ;)

OB ODPS - towens
Subject Matter Expert
Subject Matter Expert
Posts: 166
Joined: Fri Feb 05, 2021 9:17 am America/New_York

File access problems

by OB ODPS - towens » Fri Dec 21, 2018 9:07 am America/New_York

Looks like the web folks have it sorted out. You can retry your queries, they should work.
Sorry for the trouble.
Tommy

pgarnesson
Posts: 13
Joined: Mon Dec 14, 2009 11:04 am America/New_York

File access problems

by pgarnesson » Wed Jan 02, 2019 4:15 am America/New_York

Hi,
we have similar issue to get some files, for instance:
https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018225.L3m_DAY_SNPP_CHL_chlor_a_4km.nc
but is is fine with others. The problem seems linked to the file, not  to the connection.
Details below:
wget https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018226.L3m_DAY_SNPP_CHL_chlor_a_4km.nc
converted 'https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018226.L3m_DAY_SNPP_CHL_chlor_a_4km.nc' (ANSI_X3.4-1968) -> 'https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018226.L3m_DAY_SNPP_CHL_chlor_a_4km.nc' (UTF-8)
--2019-01-02 10:12:46--  https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/V2018226.L3m_DAY_SNPP_CHL_chlor_a_4km.nc
Resolving oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)... xx.xxx.xx.xx, 2001:4d0:2418:128::84
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|xx.xxx.xx.xx|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2019-01-02 10:12:58 ERROR 404: Not Found.

benj
Posts: 22
Joined: Fri Jun 18, 2010 8:30 am America/New_York

File access problems

by benj » Wed Jan 02, 2019 7:25 am America/New_York

Confirmed that we're getting the same thing again. Also the index page is coming and going - sometimes it works, sometimes we get a connection error.
I assume you guys are all taking an extended holiday courtesy of the shutdown, so I assume nothing is going to happen on this until that gets sorted out. Would be nice though!

EDIT: I should say, NRT files look OK, maybe it's recent refined things and/or ancillary that aren't behaving?

OB WebDev - dana.r.wilson
Subject Matter Expert
Subject Matter Expert
Posts: 48
Joined: Mon Apr 20, 2020 8:04 am America/New_York

File access problems

by OB WebDev - dana.r.wilson » Wed Jan 02, 2019 8:35 am America/New_York

We are having server issues this morning.  The admins are working to fix the issue.

OB WebDev - dana.r.wilson
Subject Matter Expert
Subject Matter Expert
Posts: 48
Joined: Mon Apr 20, 2020 8:04 am America/New_York

File access problems

by OB WebDev - dana.r.wilson » Wed Jan 02, 2019 9:42 am America/New_York

We were having server issues this morning.  The server admins have corrected the issue and you should be able to access the data.

OB WebDev - dana.r.wilson
Subject Matter Expert
Subject Matter Expert
Posts: 48
Joined: Mon Apr 20, 2020 8:04 am America/New_York

File access problems

by OB WebDev - dana.r.wilson » Wed Jan 02, 2019 9:42 am America/New_York

We were having server issues this morning.  The server admins have corrected the issue and you should be able to access the data.

Post Reply