Page 1 of 1

extracting costumized TROPOMI data fails

Posted: Sun Nov 19, 2023 11:23 am America/New_York
by malik_da
Dear community,

I'm experiencing difficulties extracting TROPOMI CO data (Sentinel-5P TROPOMI Carbon Monoxide CO Column 1-Orbit L2 5.5km x 7km V2) from GES DISC on Earth Data. When attempting to retrieve data from a specified area using a rectangle, I consistently encounter an error message. Despite dedicated efforts over the past three weeks, I have been unsuccessful. Any insights or assistance would be greatly appreciated.

Thank you.
The URL used: https://search.earthdata.nasa.gov/search/granules?p=C2087132178-GES_DISC!C2087132178-GES_DISC&pg[1][a]=2559318259!GES_DISC&pg[1][v]=t&pg[1][gsk]=-start_date&q=S5P_L2__CO_____1&sb[0]=0.14063%2C37.73065%2C36%2C55.31766&tl=1700329645!3!!&lat=11.0390625&long=-15.468750000000002

Re: extracting costumized TROPOMI data fails

Posted: Mon Nov 20, 2023 10:29 am America/New_York
by GES DISC - mgreene
Thank you for your question. A Subject Matter Expert has been notified and will answer your question shortly.

Re: extracting costumized TROPOMI data fails

Posted: Mon Nov 20, 2023 3:07 pm America/New_York
by GES DISC - mgreene
Hello,

Thank you for your interest in using Sentinel-5P data at GES DISC. There is currently an issue with variable subsetting in the Earthdata Harmony tool, and staff are working to fix it. Please try your request again without selecting a variable subset and let us know if this resolves your error message. We apologize for the inconvenience this may cause.

If you still wish to request a subset of variables, you may try the NASA GES DISC Subsetting Tool, which can be found on the GES DISC data product landing page: https://disc.gsfc.nasa.gov/datasets/S5P_L2__CO_____HiR_2/summary?keywords=S5P_L2__CO_____HiR_2. Click the “Subset/Get Data” button on the right side of the page to put in a subset request.

Please let us know if you have any other questions or if we can further assist you.

Re: extracting costumized TROPOMI data fails

Posted: Tue Nov 21, 2023 4:34 am America/New_York
by malik_da
Thank you for the fast reply.
I'm encountering a similar issue with the OCO-2 subsetted data (OCO-2 Level 2 bias-corrected XCO2 and other select fields from the full-physics retrieval aggregated as daily files, Retrospective processing V11r (OCO2_L2_Lite_FP) at GES DISC) (URL: https://search.earthdata.nasa.gov/search/granules?p=C2248652664-GES_DISC&pg[0][v]=f&pg[0][gsk]=-start_date&q=OCO2_L2_Lite_FP&ff=Customizable&tl=1700555898!3!!&lat=48.095947265625&long=10.248046875&zoom=7); it initiates loading but fails to complete. Your prompt attention to this matter is greatly appreciated.

Re: extracting costumized TROPOMI data fails

Posted: Tue Nov 21, 2023 10:39 am America/New_York
by GES DISC - mgreene
Hello,
This is to inform you that the variable subsetting bug in Earthdata Search affects OCO2_L2_Lite_FP as well as S5P_L2__CO___Hir_2. The fix is to use the GES DISC subsetting instead. The EDSC fix is projected to make it to OPS on 6/Dec/2023.

Regards

Re: extracting costumized TROPOMI data fails

Posted: Tue Nov 21, 2023 3:45 pm America/New_York
by malik_da
Unfortunately, the GES DISC subsetting functionality is also currently experiencing issues, failing to provide accurate and reliable results. When attempting to retrieve data for a specific area, the generated URLs for the nc4 files include numerous links, many of which turn out to be empty upon download. Additionally, the subsetting process lacks reliability, often resulting in files that should contain data but are instead empty. This discrepancy is evident when comparing the obtained data through subsetting with the results from selecting "earth data search" instead of "Subset / Get data" when it used to work.

Re: extracting costumized TROPOMI data fails

Posted: Wed Nov 29, 2023 4:17 pm America/New_York
by GES DISC - mgreene
The fix is projected to make it to OPS on 6/Dec/2023. Apologize for any inconvenience.

Re: extracting costumized TROPOMI data fails

Posted: Fri Dec 08, 2023 4:41 am America/New_York
by malik_da
Unfortunately, I'm still encountering issues with the subsetted data for OCO-2 (https://search.earthdata.nasa.gov/search/granules?p=C2248652664-GES_DISC&pg[0][v]=f&pg[0][gsk]=-start_date&q=OCO2_L2_Lite_FP&tl=1702028308.602!3!!&lat=49.50280054770827&long=2.42578125&zoom=7) and TROPOMI CO (https://search.earthdata.nasa.gov/search/granules?p=C2087132178-GES_DISC&pg[0][v]=f&pg[0][gsk]=-start_date&q=S5P_L2__CO_____1&tl=1702028465.21!3!!), and the errors persist even after attempting the suggested fix. Given that my thesis deadline is at the end of December, it's imperative to resolve this issue promptly to proceed with the data evaluation.

Re: extracting costumized TROPOMI data fails

Posted: Tue Jan 02, 2024 10:25 am America/New_York
by GES DISC - mgreene