extracting costumized TROPOMI data fails

[malik_da]

Dear community,

I'm experiencing difficulties extracting TROPOMI CO data (Sentinel-5P TROPOMI Carbon Monoxide CO Column 1-Orbit L2 5.5km x 7km V2) from GES DISC on Earth Data. When attempting to retrieve data from a specified area using a rectangle, I consistently encounter an error message. Despite dedicated efforts over the past three weeks, I have been unsuccessful. Any insights or assistance would be greatly appreciated.

Thank you.
The URL used: https://search.earthdata.nasa.gov/search/granules?p=C2087132178-GES_DISC!C2087132178-GES_DISC&pg[1][a]=2559318259!GES_DISC&pg[1][v]=t&pg[1][gsk]=-start_date&q=S5P_L2__CO_____1&sb[0]=0.14063%2C37.73065%2C36%2C55.31766&tl=1700329645!3!!&lat=11.0390625&long=-15.468750000000002

[mgreene]

Thank you for your question. A Subject Matter Expert has been notified and will answer your question shortly.

[mgreene]

Hello,

Thank you for your interest in using Sentinel-5P data at GES DISC. There is currently an issue with variable subsetting in the Earthdata Harmony tool, and staff are working to fix it. Please try your request again without selecting a variable subset and let us know if this resolves your error message. We apologize for the inconvenience this may cause.

If you still wish to request a subset of variables, you may try the NASA GES DISC Subsetting Tool, which can be found on the GES DISC data product landing page: https://disc.gsfc.nasa.gov/datasets/S5P_L2__CO_____HiR_2/summary?keywords=S5P_L2__CO_____HiR_2. Click the “Subset/Get Data” button on the right side of the page to put in a subset request.

Please let us know if you have any other questions or if we can further assist you.

[malik_da]

Thank you for the fast reply.
I'm encountering a similar issue with the OCO-2 subsetted data (OCO-2 Level 2 bias-corrected XCO2 and other select fields from the full-physics retrieval aggregated as daily files, Retrospective processing V11r (OCO2_L2_Lite_FP) at GES DISC) (URL: https://search.earthdata.nasa.gov/search/granules?p=C2248652664-GES_DISC&pg[0][v]=f&pg[0][gsk]=-start_date&q=OCO2_L2_Lite_FP&ff=Customizable&tl=1700555898!3!!&lat=48.095947265625&long=10.248046875&zoom=7); it initiates loading but fails to complete. Your prompt attention to this matter is greatly appreciated.

[mgreene]

Hello,
This is to inform you that the variable subsetting bug in Earthdata Search affects OCO2_L2_Lite_FP as well as S5P_L2__CO___Hir_2. The fix is to use the GES DISC subsetting instead. The EDSC fix is projected to make it to OPS on 6/Dec/2023.

Regards

[malik_da]

Unfortunately, the GES DISC subsetting functionality is also currently experiencing issues, failing to provide accurate and reliable results. When attempting to retrieve data for a specific area, the generated URLs for the nc4 files include numerous links, many of which turn out to be empty upon download. Additionally, the subsetting process lacks reliability, often resulting in files that should contain data but are instead empty. This discrepancy is evident when comparing the obtained data through subsetting with the results from selecting "earth data search" instead of "Subset / Get data" when it used to work.

[mgreene]

The fix is projected to make it to OPS on 6/Dec/2023. Apologize for any inconvenience.

[malik_da]

Unfortunately, I'm still encountering issues with the subsetted data for OCO-2 (https://search.earthdata.nasa.gov/search/granules?p=C2248652664-GES_DISC&pg[0][v]=f&pg[0][gsk]=-start_date&q=OCO2_L2_Lite_FP&tl=1702028308.602!3!!&lat=49.50280054770827&long=2.42578125&zoom=7) and TROPOMI CO (https://search.earthdata.nasa.gov/search/granules?p=C2087132178-GES_DISC&pg[0][v]=f&pg[0][gsk]=-start_date&q=S5P_L2__CO_____1&tl=1702028465.21!3!!), and the errors persist even after attempting the suggested fix. Given that my thesis deadline is at the end of December, it's imperative to resolve this issue promptly to proceed with the data evaluation.

[mgreene]

Please see the following How-To for assistance?

https://disc.gsfc.nasa.gov/information/howto?keywords=Level%202%20subsetter&title=How%20to%20Subset%20Level-2%20Data