Corrupted files downloaded by curl

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
oo_processing
Posts: 338
Joined: Wed Apr 06, 2005 12:11 pm America/New_York
Answers: 0
Has thanked: 10 times
Been thanked: 3 times

Corrupted files downloaded by curl

by oo_processing » Fri Jun 28, 2024 6:32 pm America/New_York

Dear Support,

I had to re-download twice to fix the file. You won't repeat for this exact file. But I believe it would happen to many files that were downloaded by any users during a certain time period of this week.
[yuyuan@optics1]$ rm ~/.urs_cookies; curl -b ~/.urs_cookies -c ~/.urs_cookies -L -n --retry 5 --retry-delay 2 --max-time 0 --remote-name-all https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/A2011304193000.L1A_LAC.bz2
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 162 0 162 0 0 520 0 --:--:-- --:--:-- --:--:-- 520
0 0 0 381 0 0 1107 0 --:--:-- --:--:-- --:--:-- 1107
0 0 0 545 0 0 1450 0 --:--:-- --:--:-- --:--:-- 1450
0 0 0 141 0 0 164 0 --:--:-- --:--:-- --:--:-- 164
0 0 0 319 0 0 292 0 --:--:-- 0:00:01 --:--:-- 0
7 210M 7 16.4M 0 0 2580k 0 0:01:23 0:00:06 0:01:17 4774k
curl: (18) transfer closed with 203596944 bytes remaining to read
[yuyuan@optics1 renamed]$ rm ~/.urs_cookies; curl -b ~/.urs_cookies -c ~/.urs_cookies -L -n --retry 5 --retry-delay 2 --max-time 0 --remote-name-all https://oceandata.sci.gsfc.nasa.gov/cgi/getfile/A2011304193000.L1A_LAC.bz2
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 162 0 162 0 0 121 0 --:--:-- 0:00:01 --:--:-- 121
0 0 0 381 0 0 268 0 --:--:-- 0:00:01 --:--:-- 0
0 0 0 545 0 0 375 0 --:--:-- 0:00:01 --:--:-- 375
0 0 0 141 0 0 83 0 --:--:-- 0:00:01 --:--:-- 83
0 0 0 319 0 0 175 0 --:--:-- 0:00:01 --:--:-- 175
100 210M 100 210M 0 0 21.6M 0 0:00:09 0:00:09 --:--:-- 47.0M
Thanks,
Yuyuan

Filters:

OB General Science - guoqingw
Subject Matter Expert
Subject Matter Expert
Posts: 110
Joined: Fri Jun 03, 2022 10:54 am America/New_York
Answers: 0
Location: NASA GSFC
Been thanked: 8 times
Contact:

Re: Corrupted files downloaded by curl

by OB General Science - guoqingw » Tue Sep 24, 2024 4:59 pm America/New_York

Hi Yuyuan,

I wanted to check in and see if you’re still experiencing any issues. The team has implemented fixes, so please let me know if the problem persists.

Thank you!
Guoqing

oo_processing
Posts: 338
Joined: Wed Apr 06, 2005 12:11 pm America/New_York
Answers: 0
Has thanked: 10 times
Been thanked: 3 times

Re: Corrupted files downloaded by curl

by oo_processing » Fri Oct 11, 2024 12:52 pm America/New_York

Thanks Guoqing,

I haven't encountered the same issue.

Yuyuan

Post Reply