Error 404 with file_search API

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
dem1
Posts: 62
Joined: Mon Nov 28, 2005 4:49 am America/New_York

Error 404 with file_search API

by dem1 » Wed May 04, 2022 8:44 am America/New_York

Hi,

Since yesterday 17:30 UTC it seems we get a lot more HTTP 404 errors when trying to use your file search API https://oceandata.sci.gsfc.nasa.gov/api/file_search
Some HTTP requests succeed (rarely) but for the majority them we get a 404 error.
We found no wrong usage on our side, are there some issues/changes on your side?

Thanks in advance,
Julien

Tags:

OB ODPS - towens
Subject Matter Expert
Subject Matter Expert
Posts: 192
Joined: Fri Feb 05, 2021 9:17 am America/New_York

Re: Error 404 with file_search API

by OB ODPS - towens » Wed May 04, 2022 8:53 am America/New_York

We are working through an issue that is causing intermittent external database availability problems. That is likely the cause of your 404s.

Tommy

dem1
Posts: 62
Joined: Mon Nov 28, 2005 4:49 am America/New_York

Re: Error 404 with file_search API

by dem1 » Fri May 06, 2022 6:41 am America/New_York

Hi,

Do you have some news about this issue?

Thanks in advance,
Julien

sarahogan_08
Posts: 1
Joined: Mon May 09, 2022 7:36 am America/New_York

Re: Error 404 with file_search API

by sarahogan_08 » Mon May 09, 2022 7:40 am America/New_York

Any luck? I am having the same issue.

garnthev
Posts: 5
Joined: Mon Feb 08, 2016 9:27 am America/New_York

Re: Error 404 with file_search API

by garnthev » Mon May 09, 2022 4:50 pm America/New_York

Dear Tommy,
is this issue still under investigation?
Do you suggest a workaround?
Thank You in advance.
Philippe

OB WebDev - dana.r.wilson
Subject Matter Expert
Subject Matter Expert
Posts: 62
Joined: Mon Apr 20, 2020 8:04 am America/New_York

Re: Error 404 with file_search API

by OB WebDev - dana.r.wilson » Fri May 13, 2022 9:40 am America/New_York

The issues should be resolved.

dem1
Posts: 62
Joined: Mon Nov 28, 2005 4:49 am America/New_York

Re: Error 404 with file_search API

by dem1 » Fri May 13, 2022 11:57 am America/New_York

Hi,

Sorry but on our side we still have the same issue: for the majority of requests we get a 404 error.

Julien

navoclimo
Posts: 1
Joined: Fri May 13, 2022 2:32 pm America/New_York

Re: Error 404 with file_search API

by navoclimo » Fri May 13, 2022 2:33 pm America/New_York

I am also seeing the same:

Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|169.154.128.84|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2022-05-13 13:27:49 ERROR 404: Not Found.

OB WebDev - dana.r.wilson
Subject Matter Expert
Subject Matter Expert
Posts: 62
Joined: Mon Apr 20, 2020 8:04 am America/New_York

Re: Error 404 with file_search API

by OB WebDev - dana.r.wilson » Fri May 13, 2022 3:13 pm America/New_York

navoclimo wrote: Fri May 13, 2022 2:33 pm America/New_York I am also seeing the same:

Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|169.154.128.84|:443... connected.
HTTP request sent, awaiting response... 404 Not Found
2022-05-13 13:27:49 ERROR 404: Not Found.
Can you post the username, public ip and the file and the url you are using

dem1
Posts: 62
Joined: Mon Nov 28, 2005 4:49 am America/New_York

Re: Error 404 with file_search API

by dem1 » Mon May 16, 2022 4:13 am America/New_York

Our configuration:

username: globcolour
public IP: 5.252.148.9
file: no file because we have the error using the file_search API (our usage is construct a list of recent products with several calls to file_search then download the ones we don't have locally)

Example of our HTTP request using Python:

Code: Select all

session.request('POST', 'https://oceandata.sci.gsfc.nasa.gov/api/file_search', data={'sensor': 'terra', 'sdate': '2021-10-28', 'edate': '2021-10-31', 'psdate': '2021-10-28', 'pedate': None, 'dtype': 'L2', 'search': 'T*.L2_LAC_OC.nc', 'std_only': 1, 'cksum': 1, 'results_as_file': '1', 'format': 'txt'})
Corresponding raw request:

Code: Select all

POST https://oceandata.sci.gsfc.nasa.gov/api/file_search
User-Agent: python-requests/2.21.0
Accept-Encoding: gzip, deflate
Accept: */*
Connection: keep-alive
Content-Length: 146
Content-Type: application/x-www-form-urlencoded
Authorization: Basic Z2xvYmNvbG91cjpHbG9iQ29sb3VyMzYw
sensor=terra&sdate=2021-10-28&edate=2021-10-31&psdate=2021-10-28&dtype=L2&search=T%2A.L2_LAC_OC.nc&std_only=1&cksum=1&results_as_file=1&format=txt

Post Reply