Authentication failure - using wget via HPC based Linux
-
GES DISC - mgreene
- User Services
- Posts: 154
- Joined: Wed Sep 25, 2019 9:35 am America/New_York
- Been thanked: 1 time
Re: Authentication failure - using wget via HPC based Linux
Following up to see if the information provided met your data and service needs. Regards,
Tags:
Re: Authentication failure - using wget via HPC based Linux
Thank you for your response. To clarify my previous inquiry, I'm inquiring whether it's feasible to compute monthly average PM1 and PM10 values utilizing your remote service, such as cloud computing, and subsequently retrieve the finalized data product. This request is prompted by the substantial data size, exceeding 51 terabytes.
-
GES DISC - mgreene
- User Services
- Posts: 154
- Joined: Wed Sep 25, 2019 9:35 am America/New_York
- Been thanked: 1 time
Re: Authentication failure - using wget via HPC based Linux
Yes, regarding the inquiry about remote accessing MERRA-2 data.
----------------------------------
We do provide options for remote accessing MERRA-2 data.
1) AWS cloud: MERRA-2 collections have been migrated to the AWS cloud US-west-2 region. So you are in the US-west-2 region, you can access S3 bucket following this How-to: How to Directly Access MERRA-2 Data from an S3 Bucket with Python from a Cloud Environment (https://disc.gsfc.nasa.gov/information/howto?keywords=%22Earthdata%20Cloud%22&title=How%20to%20Directly%20Access%20MERRA-2%20Data%20from%20an%20S3%20Bucket%20with%20Python%20from%20a%20Cloud%20Environment)
2) OPeNDAP: MERRA-2 collections could be remotely accessed through the OPeNDAP data service. You can access it from any place, say, your local machine, following this How-to "How to Access MERRA-2 Data using OPeNDAP with Python3 and Calculate Daily/Weekly/Monthly Statistics from Hourly Data" (https://disc.gsfc.nasa.gov/information/howto?keywords=OPendap&title=How%20to%20Access%20MERRA-2%20Data%20using%20OPeNDAP%20with%20Python3%20and%20Calculate%20Daily%2FWeekly%2FMonthly%20Statistics%20from%20Hourly%20Data%20).
In addition, I would suggest you try an API to subset and download MERRA-2 data, following "How to Use the Web Services API for Subsetting MERRA-2 Data"
(https://disc.gsfc.nasa.gov/information/howto?keywords=API&title=How%20to%20Use%20the%20Web%20Services%20API%20for%20Subsetting%20MERRA-2%20Data)
Note that the speed might be slow in all options above due to the large volume of the 3D collection.
GES DISC MERRA-2 support team
----------------------------------
We do provide options for remote accessing MERRA-2 data.
1) AWS cloud: MERRA-2 collections have been migrated to the AWS cloud US-west-2 region. So you are in the US-west-2 region, you can access S3 bucket following this How-to: How to Directly Access MERRA-2 Data from an S3 Bucket with Python from a Cloud Environment (https://disc.gsfc.nasa.gov/information/howto?keywords=%22Earthdata%20Cloud%22&title=How%20to%20Directly%20Access%20MERRA-2%20Data%20from%20an%20S3%20Bucket%20with%20Python%20from%20a%20Cloud%20Environment)
2) OPeNDAP: MERRA-2 collections could be remotely accessed through the OPeNDAP data service. You can access it from any place, say, your local machine, following this How-to "How to Access MERRA-2 Data using OPeNDAP with Python3 and Calculate Daily/Weekly/Monthly Statistics from Hourly Data" (https://disc.gsfc.nasa.gov/information/howto?keywords=OPendap&title=How%20to%20Access%20MERRA-2%20Data%20using%20OPeNDAP%20with%20Python3%20and%20Calculate%20Daily%2FWeekly%2FMonthly%20Statistics%20from%20Hourly%20Data%20).
In addition, I would suggest you try an API to subset and download MERRA-2 data, following "How to Use the Web Services API for Subsetting MERRA-2 Data"
(https://disc.gsfc.nasa.gov/information/howto?keywords=API&title=How%20to%20Use%20the%20Web%20Services%20API%20for%20Subsetting%20MERRA-2%20Data)
Note that the speed might be slow in all options above due to the large volume of the 3D collection.
GES DISC MERRA-2 support team