Authentication failure - using wget via HPC based Linux

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
GES DISC - mgreene
User Services
User Services
Posts: 196
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: Authentication failure - using wget via HPC based Linux

by GES DISC - mgreene » Fri Jun 30, 2023 8:39 am America/New_York

Following up to see if the information provided met your data and service needs. Regards,

Tags:

pmamegbor
Posts: 11
Joined: Wed Apr 19, 2023 1:55 pm America/New_York
Answers: 0

Re: Authentication failure - using wget via HPC based Linux

by pmamegbor » Thu Sep 07, 2023 10:17 pm America/New_York

Thank you for your response. To clarify my previous inquiry, I'm inquiring whether it's feasible to compute monthly average PM1 and PM10 values utilizing your remote service, such as cloud computing, and subsequently retrieve the finalized data product. This request is prompted by the substantial data size, exceeding 51 terabytes.

GES DISC - mgreene
User Services
User Services
Posts: 196
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: Authentication failure - using wget via HPC based Linux

by GES DISC - mgreene » Fri Sep 08, 2023 10:28 am America/New_York

Yes, regarding the inquiry about remote accessing MERRA-2 data.

----------------------------------
We do provide options for remote accessing MERRA-2 data.
1) AWS cloud: MERRA-2 collections have been migrated to the AWS cloud US-west-2 region. So you are in the US-west-2 region, you can access S3 bucket following this How-to: How to Directly Access MERRA-2 Data from an S3 Bucket with Python from a Cloud Environment (https://disc.gsfc.nasa.gov/information/howto?keywords=%22Earthdata%20Cloud%22&title=How%20to%20Directly%20Access%20MERRA-2%20Data%20from%20an%20S3%20Bucket%20with%20Python%20from%20a%20Cloud%20Environment)

2) OPeNDAP: MERRA-2 collections could be remotely accessed through the OPeNDAP data service. You can access it from any place, say, your local machine, following this How-to "How to Access MERRA-2 Data using OPeNDAP with Python3 and Calculate Daily/Weekly/Monthly Statistics from Hourly Data" (https://disc.gsfc.nasa.gov/information/howto?keywords=OPendap&title=How%20to%20Access%20MERRA-2%20Data%20using%20OPeNDAP%20with%20Python3%20and%20Calculate%20Daily%2FWeekly%2FMonthly%20Statistics%20from%20Hourly%20Data%20).

In addition, I would suggest you try an API to subset and download MERRA-2 data, following "How to Use the Web Services API for Subsetting MERRA-2 Data"
(https://disc.gsfc.nasa.gov/information/howto?keywords=API&title=How%20to%20Use%20the%20Web%20Services%20API%20for%20Subsetting%20MERRA-2%20Data)

Note that the speed might be slow in all options above due to the large volume of the 3D collection.

GES DISC MERRA-2 support team

Post Reply