Search found 297 matches

by oo_processing
Fri May 15, 2020 5:51 pm America/New_York
Forum: Home
Question: Curl Maximum redirects and fails
Replies: 10

Curl Maximum redirects and fails

Sean,I think there may be some interesting things in the verbose output. (Still slower than it used to be. An hour to d/l 47 files :confused: )This is interesting:In the 47th file:< Connection: keep-alive                           ...
by oo_processing
Fri May 15, 2020 5:06 pm America/New_York
Forum: Home
Question: Curl Maximum redirects and fails
Replies: 10

Curl Maximum redirects and fails

Sean,
What is the hard limit on the keep-alive requests? And is that per connection, or per user?
:)
Brock
by oo_processing
Fri May 15, 2020 4:48 pm America/New_York
Forum: Home
Question: Curl Maximum redirects and fails
Replies: 10

Curl Maximum redirects and fails

I'm going to look at the verbose thing as well. Is there a hard limit on the number of sessions a user can connect with.So, If NASA is seeing me (oo_username) coming in from various interfaces, that there is an issue?So, I have several interfaces to d/l data, and all use the same user and pass (...
by oo_processing
Fri May 15, 2020 4:06 pm America/New_York
Forum: Home
Question: Curl Maximum redirects and fails
Replies: 10

Curl Maximum redirects and fails

Sean,I sent a separate msg to Chris as well.I have at least one user having this issue on another campus with IPv4 (I use IPv6 where I am).She indicates that she doesn't have this problem with MERIS and OLCI file downloads. They all work in the same manner.She reports all works well for MERIS an...
by oo_processing
Fri May 15, 2020 3:20 pm America/New_York
Forum: Home
Question: Curl Maximum redirects and fails
Replies: 10

Curl Maximum redirects and fails

Sean,I'm seeing this issue again. As soon as 47 files are downloaded, it says Max redirects and fails. Notice that I am feeding curl a list so as to keep network connections alive.The interface numbers I've used are 2607:fe50:0:6330::100 -> 2607:fe50:0:6330::109 with the same resultsAll of t...
by oo_processing
Thu May 14, 2020 4:34 pm America/New_York
Forum: Home
Question: Subscription areas
Replies: 6

Subscription areas

Sean,Great news. We plan on incorporating it into one of our product regions as a showcase. So, for instance, we may have MODIST MODISA VIIRS and OLCI in lets say FLKEYS.We will want the L1 files. I suspect you will provide the option to choose either when you do offer subscriptions?Cheers, and stay...
by oo_processing
Wed May 13, 2020 10:29 pm America/New_York
Forum: Home
Question: PDS files in subscriptions now in both bz2 and 'data' format
Replies: 16

PDS files in subscriptions now in both bz2 and 'data' format

Good to know. I understand there are many excellent reasons to change work flows.I can understand your motivation.I just thought it might be simple to change the push to the subscription database after the compression had been done.No harm or foul though, as that would only mean that it wouldn't...
by oo_processing
Wed May 13, 2020 6:58 pm America/New_York
Forum: Home
Question: PDS files in subscriptions now in both bz2 and 'data' format
Replies: 16

PDS files in subscriptions now in both bz2 and 'data' format

John,There might be a simple third. Wait until after the bzip2 before pushing to the subscriptions.Having said that, I have made adjustments to ignore the files returned without the bz2 extension.If, as you say, they will be bzip2'ed and found in that format from a subscriptions file search, the...
by oo_processing
Wed May 13, 2020 2:45 pm America/New_York
Forum: Home
Question: PDS files in subscriptions now in both bz2 and 'data' format
Replies: 16

PDS files in subscriptions now in both bz2 and 'data' format

Tommy,I'm guessing not:[bmurch@dell8 ~]$ curl  --retry 5 --retry-delay 2 -d "subID=1267&results_as_file=1"  https://oceandata.sci.gsfc.nasa.gov/api/file_search                                &...
by oo_processing
Wed May 13, 2020 2:25 pm America/New_York
Forum: Home
Question: Subscription areas
Replies: 6

Subscription areas

I was asked if I was able to create a subscription for OLCI L1 data?
The dashboard suggests no, but I was asked to see if the interface had just not been updated?