"Too many requests" error when using OPeNDAP

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
zacherickson
Posts: 4
Joined: Fri Apr 01, 2016 7:24 pm America/New_York

"Too many requests" error when using OPeNDAP

by zacherickson » Sun Mar 06, 2022 11:54 am America/New_York

I am starting to get "Too many requests" errors when using OPeNDAP to retrieve ocean color data. I am trying to utilize OPeNDAP rather than download large amounts of data to my computer, and am making many requests to get, for example, Rrs at a given wavelength from a single point across many days. For example (this code won't run because variables aren't defined, but you get the idea):

>>> for day in days:
>>> print(Dataset(filename(day)).variable['Rrs_412'][latind,lonind])

where an example of filename(day) is: [link] ://oceandata.sci.gsfc.nasa.gov/opendap/SeaWiFS/L3SMI/2000/001/S2000001.L3m_DAY_RRS_Rrs_412_9km.nc

for, say, a full year. I'll get "Too many requests" errors and then won't be able to access certain files. Is this approach not kosher? I.e., should I be downloading data and not trying to use the cloud for this? I don't recall this happening when I was doing things like this years ago, but maybe something changed and this is no longer a good way to deal with OceanColor data.

The specific error I am given is:

syntax error, unexpected WORD_WORD, expecting SCAN_ATTR or SCAN_DATASET or SCAN_ERROR
context: <html^><head><title>429 Too Many Requests</title></head><body><center><h1>429 Too Many Requests</h1></center><hr><center>nginx</center></body></html>

Tags:

christophermoellers
Posts: 4
Joined: Fri Jul 10, 2020 10:58 am America/New_York

Re: "Too many requests" error when using OPeNDAP

by christophermoellers » Mon Mar 07, 2022 2:23 pm America/New_York

Zach,

Give it a try now. The limits have been increased.

zacherickson
Posts: 4
Joined: Fri Apr 01, 2016 7:24 pm America/New_York

Re: "Too many requests" error when using OPeNDAP

by zacherickson » Tue Mar 08, 2022 6:36 pm America/New_York

Thanks so much! It works great now :)

Post Reply