Downloading VIIRS Ocean Color level-1 and 2 Files Issue

[durjoy33]

Dear Support Team,

I hope this message finds you well. I am currently encountering challenges while attempting to download VIIRS ocean color geo files from the Level-1 and Level-2 browser using the wget command.

Here is a detailed overview of the issue:

Command Used: wget
URL of dataset:
[https://oceandata.sci.gsfc.nasa.gov/getfile/urs/?code=KM3r9O4gaUU8eR0LfEszL7WHLu0bqaYStlx95eQmBf18PmeGW0Dtzp3SsA]
Problem Description: The download process frequently halts, and despite multiple retry attempts, the issue persists.
Additional Information:
Location: https://oceandata.sci.gsfc.nasa.gov/getfile/urs/?code=KM3r9O4gaUU8eR0LfEszL7WHLu0bqaYStlx95eQmBf18PmeGW0Dtzp3SsA [following]
--2023-11-13 00:08:09-- https://oceandata.sci.gsfc.nasa.gov/getfile/urs/?code=KM3r9O4gaUU8eR0LfEszL7WHLu0bqaYStlx95eQmBf18PmeGW0Dtzp3SsA
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|169.154.128.84|:443... connected.
HTTP request sent, awaiting response... 302 FOUND
Location: https://oceandata.sci.gsfc.nasa.gov/getfile/requested_files_1.tar?h=ocdist305&p=%2Fdata1%2F80f033bede4a5563%2Frequested_files [following]
--2023-11-13 00:08:11-- https://oceandata.sci.gsfc.nasa.gov/getfile/requested_files_1.tar?h=ocdist305&p=%2Fdata1%2F80f033bede4a5563%2Frequested_files
Reusing existing connection to oceandata.sci.gsfc.nasa.gov:443.
HTTP request sent, awaiting response... 200 OK
Length: 1089536000 (1.0G) [application/octet-stream]
Saving to: ‘requested_files_1.tar.1’

requested_files_1.tar.1 2%[> ] 23.21M 601KB/s in 37s

2023-11-13 00:08:48 (650 KB/s) - Connection closed at byte 24335259. Retrying.

--2023-11-13 00:08:49-- (try: 2) https://oceandata.sci.gsfc.nasa.gov/getfile/requested_files_1.tar?h=ocdist305&p=%2Fdata1%2F80f033bede4a5563%2Frequested_files
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|169.154.128.84|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1089536000 (1.0G) [application/octet-stream]
Saving to: ‘requested_files_1.tar.1’

requested_files_1.tar.1 2%[> ] 23.63M 695KB/s in 37s

2023-11-13 00:09:27 (647 KB/s) - Connection closed at byte 24775208. Retrying.

--2023-11-13 00:09:29-- (try: 3) https://oceandata.sci.gsfc.nasa.gov/getfile/requested_files_1.tar?h=ocdist305&p=%2Fdata1%2F80f033bede4a5563%2Frequested_files
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|169.154.128.84|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1089536000 (1.0G) [application/octet-stream]
Saving to: ‘requested_files_1.tar.1’

requested_files_1.tar.1 2%[=> ] 29.96M 688KB/s in 48s

2023-11-13 00:10:19 (639 KB/s) - Connection closed at byte 31412496. Retrying.

--2023-11-13 00:10:22-- (try: 4) https://oceandata.sci.gsfc.nasa.gov/getfile/requested_files_1.tar?h=ocdist305&p=%2Fdata1%2F80f033bede4a5563%2Frequested_files
Connecting to oceandata.sci.gsfc.nasa.gov (oceandata.sci.gsfc.nasa.gov)|169.154.128.84|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1089536000 (1.0G) [application/octet-stream]
Saving to: ‘requested_files_1.tar.1’

requested_files_1.tar.1 2%[> ] 23.71M 703KB/s in 39s

2023-11-13 00:11:03 (617 KB/s) - Connection closed at byte 31412496. Retrying.

I have attempted various solutions, including the use of the -c option for resuming downloads, but the interruptions persist. Your prompt assistance in resolving this matter and facilitating a successful download would be greatly appreciated.

Thank you for your attention to this issue.

Best Regards,
Durjoy

[OB ODPS - towens]

I can download that URL locally. There may be a network problem on your side. try adding the --verbose flag to your wget command

Code: Select all

HTTP request sent, awaiting response... 200 OK
Length: 1089536000 (1.0G) [application/octet-stream]
Saving to: 'requested_files_1.tar?h=ocdist305&p=%2Fdata1%2F80f033bede4a5563%2Frequested_files'

requested_files_1.tar?h=ocdist305&p=%2Fdata1%2F80f033bede 100%[=====================================================================================================================================>]   1.01G   104MB/s    in 9.8s

2023-11-14 19:16:34 (106 MB/s) - 'requested_files_1.tar?h=ocdist305&p=%2Fdata1%2F80f033bede4a5563%2Frequested_files' saved [1089536000/1089536000]