Page 1 of 1

Bulk Download Problem

Posted: Tue Jul 04, 2023 9:16 am America/New_York
by amirhossein
Hello everyone,
When I copy the MODIS-AOD text file links into the Free Download Manager to download links automatically (Links come from Search Earth Data) returns error. Does anyone have any solution?

Re: Bulk Download Problem

Posted: Wed Jul 05, 2023 11:11 am America/New_York
by LAADS-EDL_UserServices_M
From where are you trying to download data, ladsweb, nrt, or Earthdata Cloud? Can you provide some example URLs to investigate?

Re: Bulk Download Problem

Posted: Thu Jul 06, 2023 2:19 am America/New_York
by amirhossein
Thanks for getting back to me. Here is a sample link from MODIS vegetation product.
https://data.lpdaac.earthdatacloud.nasa.gov/lp-prod-protected/MOD13Q1.061/MOD13Q1.A2020353.h23v05.061.2021012024119/MOD13Q1.A2020353.h23v05.061.2021012024119.hdf
Although my Earth Data account has already authorized for bulk download, still I have same problem for all products coming from https://search.earthdata.nasa.gov/search
However the products from https://giovanni.gsfc.nasa.gov/giovanni/ or https://appeears.earthdatacloud.nasa.gov/ downloaded automatically without any issues.

Re: Bulk Download Problem

Posted: Thu Jul 06, 2023 9:12 am America/New_York
by LP DAAC-EDL - dgolon
Hi @amirhossein A few users have reported issues accessing the MOD13Q1 data outside of the LP's Data Pool. We are looking into this issue and we will report back when we have more information. Thanks - Danielle

Re: Bulk Download Problem

Posted: Thu Jul 13, 2023 9:57 am America/New_York
by LP DAAC-EDL - dgolon
Hi @amirhossein Could you please let us know which download manager tool are you using? If interested, we have a few resources we could direct you to, to download data directly from the command line. Thanks, Danielle

Re: Bulk Download Problem

Posted: Fri Jul 14, 2023 2:54 am America/New_York
by amirhossein
Here you are:
https://www.freedownloadmanager.org/

The download manager works well in NASA Giovanni but only returns error in Search EarthData

Re: Bulk Download Problem

Posted: Tue Jul 25, 2023 10:25 am America/New_York
by LP DAAC-EDL - dgolon
Hi @amirhossein We have not used that tool before and did not create it, so unfortunately we can't help answer you question and recommend you reach out to the contact of the team that created that tool.

Alternatively, we recommend using bulk downloading using wget:

To bulk download your outputs using wget:

First, save the download list for files you want to download. If you want all the outputs, select all and then click on “Save Download List”.

Next, type the line below in command line and press enter to get a token:
(Insert your Earthdata Login username and password in the red parts.)
> wget -q -O - --method POST --user=Insert_Your_EDL_Username --password= Insert_Your_EDL_Password--auth-no-challenge https://appeears.earthdatacloud.nasa.gov/api/login

Your token should look like:
{"token_type": "Bearer", "token": "r0HkNQtYquKjkOZbY-6P8mgjA8....", "expiration": "2023-05-04T14:05:47Z"}

To download the files, type the line below in your command line and press enter:
Copy your token (purple above) and paste it instead of Insert_Your_Token below.

Also insert the full path to the saved downloaded list below (Insert_full_Path_to_Your_Download_List)

> wget --header "Authorization: Bearer Insert_Your_Token” -i Insert_full_Path_to_Your_Download_List