Does GES Disc have a server timeout limit?
Posted: Wed Jun 11, 2025 5:36 pm America/New_York
I am accessing 3 hourly GLDAS time series (GLDAS_NOAH025_3H v2.1) for a single lat/long point with a curl request for a csv file. At the moment I am also only requesting a single variable, though I will be requesting more. My authentication details are correct. When I do a shorter time request, I get the desired CSV.
For example, the following command successfully downloads a small CSV file with 5 months of 3-hourly snowfall records for the queried site:
curl -n -L -O -b ~/.urs_cookies "https://hydro1.gesdisc.eosdis.nasa.gov/thredds/ncss/grid/GLDAS_aggregation/GLDAS_NOAH025_3H.2.1/GLDAS_NOAH025_3H.2.1_Aggregation_2000.ncml?var=Snowf_tavg&latitude=45.2929&longitude=-75.767&time_start=2000-01-01T03:00:00Z&time_end=2000-05-01T21:00:00Z&&&accept=csv_file"
However, if I expand the request to all of the year 2000, I end up with an internal server error. Looking more closely, the common thread is that the data download component of the request always cuts out after 10 minutes:
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 761 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 587 0 587 0 0 886 0 --:--:-- --:--:-- --:--:-- 886
0 477 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0
100 527 0 527 0 0 0 0 --:--:-- 0:10:01 --:--:-- 145
In contrast, requests that stay under that 10:00 download time always succeed.
For example, the following command successfully downloads a small CSV file with 5 months of 3-hourly snowfall records for the queried site:
curl -n -L -O -b ~/.urs_cookies "https://hydro1.gesdisc.eosdis.nasa.gov/thredds/ncss/grid/GLDAS_aggregation/GLDAS_NOAH025_3H.2.1/GLDAS_NOAH025_3H.2.1_Aggregation_2000.ncml?var=Snowf_tavg&latitude=45.2929&longitude=-75.767&time_start=2000-01-01T03:00:00Z&time_end=2000-05-01T21:00:00Z&&&accept=csv_file"
However, if I expand the request to all of the year 2000, I end up with an internal server error. Looking more closely, the common thread is that the data download component of the request always cuts out after 10 minutes:
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
0 761 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
100 587 0 587 0 0 886 0 --:--:-- --:--:-- --:--:-- 886
0 477 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0
100 527 0 527 0 0 0 0 --:--:-- 0:10:01 --:--:-- 145
In contrast, requests that stay under that 10:00 download time always succeed.