extracting costumized TROPOMI data fails

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
malik_da
Posts: 4
Joined: Sun Nov 19, 2023 11:13 am America/New_York
Answers: 0

extracting costumized TROPOMI data fails

by malik_da » Sun Nov 19, 2023 11:23 am America/New_York

Dear community,

I'm experiencing difficulties extracting TROPOMI CO data (Sentinel-5P TROPOMI Carbon Monoxide CO Column 1-Orbit L2 5.5km x 7km V2) from GES DISC on Earth Data. When attempting to retrieve data from a specified area using a rectangle, I consistently encounter an error message. Despite dedicated efforts over the past three weeks, I have been unsuccessful. Any insights or assistance would be greatly appreciated.

Thank you.
The URL used: https://search.earthdata.nasa.gov/search/granules?p=C2087132178-GES_DISC!C2087132178-GES_DISC&pg[1][a]=2559318259!GES_DISC&pg[1][v]=t&pg[1][gsk]=-start_date&q=S5P_L2__CO_____1&sb[0]=0.14063%2C37.73065%2C36%2C55.31766&tl=1700329645!3!!&lat=11.0390625&long=-15.468750000000002
Attachments
Scrrenshot for the error message
Scrrenshot for the error message
Unbenannt.PNG (21.99 KiB) Not viewed yet

Tags:

GES DISC - mgreene
User Services
User Services
Posts: 198
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: extracting costumized TROPOMI data fails

by GES DISC - mgreene » Mon Nov 20, 2023 10:29 am America/New_York

Thank you for your question. A Subject Matter Expert has been notified and will answer your question shortly.

GES DISC - mgreene
User Services
User Services
Posts: 198
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: extracting costumized TROPOMI data fails

by GES DISC - mgreene » Mon Nov 20, 2023 3:07 pm America/New_York

Hello,

Thank you for your interest in using Sentinel-5P data at GES DISC. There is currently an issue with variable subsetting in the Earthdata Harmony tool, and staff are working to fix it. Please try your request again without selecting a variable subset and let us know if this resolves your error message. We apologize for the inconvenience this may cause.

If you still wish to request a subset of variables, you may try the NASA GES DISC Subsetting Tool, which can be found on the GES DISC data product landing page: https://disc.gsfc.nasa.gov/datasets/S5P_L2__CO_____HiR_2/summary?keywords=S5P_L2__CO_____HiR_2. Click the “Subset/Get Data” button on the right side of the page to put in a subset request.

Please let us know if you have any other questions or if we can further assist you.

malik_da
Posts: 4
Joined: Sun Nov 19, 2023 11:13 am America/New_York
Answers: 0

Re: extracting costumized TROPOMI data fails

by malik_da » Tue Nov 21, 2023 4:34 am America/New_York

Thank you for the fast reply.
I'm encountering a similar issue with the OCO-2 subsetted data (OCO-2 Level 2 bias-corrected XCO2 and other select fields from the full-physics retrieval aggregated as daily files, Retrospective processing V11r (OCO2_L2_Lite_FP) at GES DISC) (URL: https://search.earthdata.nasa.gov/search/granules?p=C2248652664-GES_DISC&pg[0][v]=f&pg[0][gsk]=-start_date&q=OCO2_L2_Lite_FP&ff=Customizable&tl=1700555898!3!!&lat=48.095947265625&long=10.248046875&zoom=7); it initiates loading but fails to complete. Your prompt attention to this matter is greatly appreciated.
Attachments
Loading process
Loading process
Unbenannt.PNG (24.15 KiB) Not viewed yet

GES DISC - mgreene
User Services
User Services
Posts: 198
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: extracting costumized TROPOMI data fails

by GES DISC - mgreene » Tue Nov 21, 2023 10:39 am America/New_York

Hello,
This is to inform you that the variable subsetting bug in Earthdata Search affects OCO2_L2_Lite_FP as well as S5P_L2__CO___Hir_2. The fix is to use the GES DISC subsetting instead. The EDSC fix is projected to make it to OPS on 6/Dec/2023.

Regards

malik_da
Posts: 4
Joined: Sun Nov 19, 2023 11:13 am America/New_York
Answers: 0

Re: extracting costumized TROPOMI data fails

by malik_da » Tue Nov 21, 2023 3:45 pm America/New_York

Unfortunately, the GES DISC subsetting functionality is also currently experiencing issues, failing to provide accurate and reliable results. When attempting to retrieve data for a specific area, the generated URLs for the nc4 files include numerous links, many of which turn out to be empty upon download. Additionally, the subsetting process lacks reliability, often resulting in files that should contain data but are instead empty. This discrepancy is evident when comparing the obtained data through subsetting with the results from selecting "earth data search" instead of "Subset / Get data" when it used to work.

GES DISC - mgreene
User Services
User Services
Posts: 198
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: extracting costumized TROPOMI data fails

by GES DISC - mgreene » Wed Nov 29, 2023 4:17 pm America/New_York

The fix is projected to make it to OPS on 6/Dec/2023. Apologize for any inconvenience.

malik_da
Posts: 4
Joined: Sun Nov 19, 2023 11:13 am America/New_York
Answers: 0

Re: extracting costumized TROPOMI data fails

by malik_da » Fri Dec 08, 2023 4:41 am America/New_York

Unfortunately, I'm still encountering issues with the subsetted data for OCO-2 (https://search.earthdata.nasa.gov/search/granules?p=C2248652664-GES_DISC&pg[0][v]=f&pg[0][gsk]=-start_date&q=OCO2_L2_Lite_FP&tl=1702028308.602!3!!&lat=49.50280054770827&long=2.42578125&zoom=7) and TROPOMI CO (https://search.earthdata.nasa.gov/search/granules?p=C2087132178-GES_DISC&pg[0][v]=f&pg[0][gsk]=-start_date&q=S5P_L2__CO_____1&tl=1702028465.21!3!!), and the errors persist even after attempting the suggested fix. Given that my thesis deadline is at the end of December, it's imperative to resolve this issue promptly to proceed with the data evaluation.

GES DISC - mgreene
User Services
User Services
Posts: 198
Joined: Wed Sep 25, 2019 9:35 am America/New_York
Answers: 2
Been thanked: 1 time

Re: extracting costumized TROPOMI data fails

by GES DISC - mgreene » Tue Jan 02, 2024 10:25 am America/New_York


Post Reply