Data processing

Please enter here to ask a question about any NASA Science related topics!
Post Reply
madhusmita
Posts: 13
Joined: Mon Jul 17, 2017 8:39 am America/New_York

Data processing

by madhusmita » Thu Sep 10, 2020 11:13 am America/New_York

Hi all
I want to download and process the data for a particular date range.
I tried by using this following code:

echo "Fiename: $line"
echo ""; echo ""; echo " "; echo " ";
wget --user=xxxxx --password=xxxxxx --auth-no-challenge=on https://oceandata.sci.gsfc.nasa.gov/echo/getfile/$line
done<$HOME/chandan/Modies_aqua/MODISA/Yyear/Yday/L1/L1_File_List_$Yyear$Yday.txt

The data is downloaded and processed for only one date (one day). For other dates only the text file is coming.

Can anyone please suggest how to download the data for multiple dates using wget.

Thanks in Advance:smile:

Tags:

OB WebDev - norman
Subject Matter Expert
Subject Matter Expert
Posts: 136
Joined: Tue Feb 09, 2021 8:19 am America/New_York

Data processing

by OB WebDev - norman » Fri Sep 11, 2020 9:54 am America/New_York

You have left out key portions of your script, but here is a method that works for me to download Aqua/MODIS L1 files for the month of January 2020.

for f in `wget -q --post-data="sensor=aqua&sdate=2020-01-01&edate=2020-01-31&dtype=L1&results_as_file=1&addurl=1&std_only=1" -O - https://oceandata.sci.gsfc.nasa.gov/api/file_search|xargs`;do
  wget --load-cookies ~/.urs_cookies --save-cookies ~/.urs_cookies --auth-no-challenge=on --content-disposition $f
done

Please see https://oceancolor.gsfc.nasa.gov/data/download_methods/ for more information.

Regards,
Norman

madhusmita
Posts: 13
Joined: Mon Jul 17, 2017 8:39 am America/New_York

Data processing

by madhusmita » Fri Sep 11, 2020 11:27 am America/New_York

Thanks Norman for your help.
Now i can able  to download the data for all the days.

Can you please help, how to crop the global data file into regional basis by providing the Geo co-ordinates.

Thanks again:smile:

OB WebDev - norman
Subject Matter Expert
Subject Matter Expert
Posts: 136
Joined: Tue Feb 09, 2021 8:19 am America/New_York

Data processing

by OB WebDev - norman » Fri Sep 11, 2020 11:36 am America/New_York

You can generate a list of URLs for files to download by using our L1 browser.
Specify your region and time period of interest, click "Find swaths", and then click "ORDER DATA" and follow the instructions.  You can get more information by clicking on the "Help" button.

Norman

madhusmita
Posts: 13
Joined: Mon Jul 17, 2017 8:39 am America/New_York

Data processing

by madhusmita » Fri Sep 11, 2020 1:32 pm America/New_York

Thank you so much Norman for your suggestions and help.

Post Reply