File access problems

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
oo_processing
Posts: 304
Joined: Wed Apr 06, 2005 12:11 pm America/New_York
Answers: 0
Has thanked: 6 times

File access problems

by oo_processing » Thu Jan 03, 2019 12:55 pm America/New_York

I am having intermittent issues as well. My clustered env in Tampa seems to be returning okay, but some machines in my lab in St. Petersburg

host xx.xxx.xx.xx
and
host xx.xxx.xx.xx

Cannot connect.

searobin 168: > curl --retry 5 --retry-delay 2 --max-time 0 -d subID=1134 https://oceandata.sci.gsfc.nasa.gov/search/file_search.cgi
curl: (7) Failed to connect to 2001:4d0:2418:128::84: Network is unreachable

seadoo 180 :/optics1/home1/oo_processing> curl --ipv4 --retry 5 --retry-delay 2 --max-time 0 -d subID=1134 https://oceandata.sci.gsfc.nasa.gov/search/file_search.cgi
curl: (7) couldn't connect to host

And no ancillary either?

> modis_GEO.py /tmp/S4P_ROI_H5_MODISA.FLKEYS.2018.353_version_0.04_bzhDy63f/MOD00.P2018353.1800.FLKEYS_FULL.L1A_LAC -o /tmp/S4P_ROI_H5_MODISA.FLKEYS.2018.353_version_0.04_bzhDy63f/MOD00.P2018353.1800.FLKEYS_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
>Error! could not establish a network connection. Check your network connection.


Thanks,
Brock

Tags:

OB.DAAC - amscott
User Services
User Services
Posts: 353
Joined: Mon Jun 22, 2020 5:24 pm America/New_York
Answers: 1
Has thanked: 8 times
Been thanked: 3 times

File access problems

by OB.DAAC - amscott » Thu Jan 03, 2019 12:58 pm America/New_York

Hi Brock,

You have an old site address stored. Please update the address for the file search utility to "https://oceandata.sci.gsfc.nasa.gov/api/file_search".

oo_processing
Posts: 304
Joined: Wed Apr 06, 2005 12:11 pm America/New_York
Answers: 0
Has thanked: 6 times

File access problems

by oo_processing » Thu Jan 03, 2019 1:38 pm America/New_York

seadoo 188 :/optics1/home1/oo_processing> curl --verbose --retry 5 --retry-delay 2 --max-time 0 -d "subID=1134&results_as_file=1" https://oceandata.sci.gsfc.nasa.gov/api/file_search
* About to connect() to oceandata.sci.gsfc.nasa.gov port 443 (#0)
*   Trying xx.xxx.xx.xx... Connection timed out
*   Trying 2001:4d0:2418:128::84... Failed to connect to 2001:4d0:2418:128::84: Network is unreachable
* Success
* couldn't connect to host
* Closing connection #0
curl: (7) Failed to connect to 2001:4d0:2418:128::84: Network is unreachable

https://oceandata.sci.gsfc.nasa.gov/search/file_search.cgi and https://oceandata.sci.gsfc.nasa.gov/api/file_search both return in the browser from my desktop.

AND THIS FAILURE of modis_GEP.py:

> modis_GEO.py /tmp/S4P_ROI_H5_MODISA.FLKEYS.2018.353_version_0.04_bzhDy63f/MOD00.P2018353.1800.FLKEYS_FULL.L1A_LAC -o /tmp/S4P_ROI_H5_MODISA.FLKEYS.2018.353_version_0.04_bzhDy63f/MOD00.P2018353.1800.FLKEYS_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
>Error! could not establish a network connection. Check your network connection.


It happens in Tampa as well (from today):
STATUS: $ocssw_command_1 = modis_L1A.py /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.ANGOLA.2018.356_version_0.05_paCRcjAW/MOD00.P2018356.1325.PDS -o /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.ANGOLA.2018.356_version_0.05_paCRcjAW/MOD00.P2018356.1325.ANGOLA_FULL.L1A_LAC --startnudge=0 --stopnudge=10
[56050 refs]
STATUS: $ocssw_return_1 = MODIS L1A version 6.0.6, built May 31 2018 12:44:52
scan: 0 out of 403 Thu Jan  3 12:02:52 2019
scan: 10 out of 403 Thu Jan  3 12:03:12 2019
scan: 20 out of 403 Thu Jan  3 12:03:16 2019
scan: 30 out of 403 Thu Jan  3 12:03:17 2019
scan: 40 out of 403 Thu Jan  3 12:03:26 2019
scan: 50 out of 403 Thu Jan  3 12:03:29 2019
scan: 60 out of 403 Thu Jan  3 12:03:31 2019
scan: 70 out of 403 Thu Jan  3 12:03:34 2019
scan: 80 out of 403 Thu Jan  3 12:03:37 2019
scan: 90 out of 403 Thu Jan  3 12:03:39 2019
scan: 100 out of 403 Thu Jan  3 12:03:42 2019
scan: 110 out of 403 Thu Jan  3 12:03:45 2019
scan: 120 out of 403 Thu Jan  3 12:03:48 2019
scan: 130 out of 403 Thu Jan  3 12:03:50 2019
scan: 140 out of 403 Thu Jan  3 12:03:54 2019
scan: 150 out of 403 Thu Jan  3 12:03:56 2019
scan: 160 out of 403 Thu Jan  3 12:04:00 2019
scan: 170 out of 403 Thu Jan  3 12:04:02 2019
scan: 180 out of 403 Thu Jan  3 12:04:05 2019
scan: 190 out of 403 Thu Jan  3 12:04:08 2019
scan: 200 out of 403 Thu Jan  3 12:04:11 2019
scan: 210 out of 403 Thu Jan  3 12:04:14 2019
scan: 220 out of 403 Thu Jan  3 12:04:16 2019
scan: 230 out of 403 Thu Jan  3 12:04:17 2019
scan: 240 out of 403 Thu Jan  3 12:04:18 2019
scan: 250 out of 403 Thu Jan  3 12:04:19 2019
scan: 260 out of 403 Thu Jan  3 12:04:20 2019
scan: 270 out of 403 Thu Jan  3 12:04:21 2019
scan: 280 out of 403 Thu Jan  3 12:04:23 2019
scan: 290 out of 403 Thu Jan  3 12:04:24 2019
scan: 300 out of 403 Thu Jan  3 12:04:25 2019
scan: 310 out of 403 Thu Jan  3 12:04:26 2019
scan: 320 out of 403 Thu Jan  3 12:04:28 2019
scan: 330 out of 403 Thu Jan  3 12:04:29 2019
scan: 340 out of 403 Thu Jan  3 12:04:30 2019
scan: 350 out of 403 Thu Jan  3 12:04:31 2019
scan: 360 out of 403 Thu Jan  3 12:04:32 2019
scan: 370 out of 403 Thu Jan  3 12:04:34 2019
scan: 380 out of 403 Thu Jan  3 12:04:34 2019
scan: 390 out of 403 Thu Jan  3 12:04:35 2019
STATUS: $l1a_file_w_vdir_path /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.ANGOLA.2018.356_version_0.05_paCRcjAW/MOD00.P2018356.1325.ANGOLA_FULL.L1A_LAC was found
STATUS: $current_directory = /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.ANGOLA.2018.356_version_0.05_paCRcjAW
STATUS: $ocssw_command_2 = modis_GEO.py /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.ANGOLA.2018.356_version_0.05_paCRcjAW/MOD00.P2018356.1325.ANGOLA_FULL.L1A_LAC -o /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.ANGOLA.2018.356_version_0.05_paCRcjAW/MOD00.P2018356.1325.ANGOLA_FULL.GEO --threshold=95 --ancdb=./ancillary_data.db
Error! could not establish a network connection. Check your network connection.
If you do not find a problem, please try again later.
[66220 refs]
STATUS: $ocssw_return_2 = Cannot create geolocation from /work/b/bmurch/tmp/S4P_MODIS_H5_MODISA.ANGOLA.2018.356_version_0.05_paCRcjAW/MOD00.P2018356.1325.ANGOLA_FULL.L1A_LAC; exiting.

OB.DAAC - amscott
User Services
User Services
Posts: 353
Joined: Mon Jun 22, 2020 5:24 pm America/New_York
Answers: 1
Has thanked: 8 times
Been thanked: 3 times

File access problems

by OB.DAAC - amscott » Thu Jan 03, 2019 1:58 pm America/New_York

Okay. I was able to see these files using the command in your post:
MOD00.P2018365.0725_1.PDS.bz2
MOD00.P2018365.0900_1.PDS.bz2
MOD00.P2018365.1655_1.PDS.bz2
MOD00.P2018365.1830_1.PDS.bz2
MOD00.P2019001.0630_1.PDS.bz2
MOD00.P2019001.0805_1.PDS.bz2
MOD00.P2019001.0810_1.PDS.bz2
MOD00.P2019001.1735_1.PDS.bz2
MOD00.P2019001.1915_1.PDS.bz2
MOD00.P2019002.0710_1.PDS.bz2
MOD00.P2019002.0715_1.PDS.bz2
MOD00.P2019002.0850_1.PDS.bz2
MOD00.P2019002.1820_1.PDS.bz2

Your IP may be blocked. Send an email to  connection_problems@oceancolor.sci.gsfc.nasa.gov with the information described in this post:
https://oceancolor.gsfc.nasa.gov/forum/oceancolor/topic_show.pl?tid=6447 and they will check it out for you.

Post Reply