Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
laxmi1000
Posts: 4
Joined: Fri May 19, 2023 9:56 am America/New_York
Answers: 0

Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by laxmi1000 » Fri May 19, 2023 10:25 am America/New_York

I am exploring spatial variability of AOD at the centre of a granule/swath of MODIS 04 Level 2 data, particularly Aqua data so that I can compare it with the data extracted from CALIOP. But, I can see that most of the AOD values along the centre (column) are missing. Is there any specific reason for this? Is there a way to address the missing data ?
Also, the coverage of the MODIS swath keeps on changing everyday. How can we address this issue if we need AOD from a particular location over a time period, let's say a month or year?

Many thanks in advance,
Laxmi

Filters:

LAADS_UserServices_M
User Services
User Services
Posts: 297
Joined: Mon Sep 30, 2019 8:33 am America/New_York
Answers: 1
Has thanked: 3 times

Re: Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by LAADS_UserServices_M » Mon May 22, 2023 11:50 am America/New_York

Dear Laxmi:
Can you provide an example from files that exhibit such behavior (couple of file names should be sufficient)?
Regards,
LAADS User Services

To receive news from LAADS DAAC direct to your inbox, email laadsdaac-join@lists.nasa.gov with “subscribe” in the subject line.

laxmi1000
Posts: 4
Joined: Fri May 19, 2023 9:56 am America/New_York
Answers: 0

Re: Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by laxmi1000 » Mon May 22, 2023 12:28 pm America/New_York

Thank you so much for your reply! Some of the file names include: MYD04_L2.A2021001.1840.061.2021002163532.hdf, MYD04_L2.A2021001.2015.061.2021002164636.hdf, MYD04_L2.A2021002.1920.061.2021003155147.hdf, MYD04_L2.A2021003.2005.061.2021004170411.hdf. I am attaching a screenshot for your reference. Many thanks in advance!
Attachments
all_modis.png
all_modis.png (351.75 KiB) Not viewed yet
MYD04_L2.A005.JPG
MYD04_L2.A005.JPG (28.66 KiB) Not viewed yet

LAADS_UserServices_M
User Services
User Services
Posts: 297
Joined: Mon Sep 30, 2019 8:33 am America/New_York
Answers: 1
Has thanked: 3 times

Re: Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by LAADS_UserServices_M » Fri May 26, 2023 11:58 am America/New_York

Dear Laxmi:
Please note the following:
Have you tried to cross-reference the missing areas with the MODIS cloud mask (MxD35_L2) to see if those areas have persistent cloud. You can also reference a RGB reflectance image for this.

With regard to this question:
coverage of the MODIS swath keeps on changing everyday. How can we address this issue if we need AOD from a particular location over a time period, let's say a month or year?

Answer: MODIS follows a 16-day repeat cycle, so they can revisit the same area, every 16-days to get AOD observations over the same at-nadir area. But also let them know that following the last set of Inclination maneuvers conducted for Terra (in early 2020) and for Aqua (Spring of 2021), their orbits are slowly drifting, affecting the exact repeatability of observations of the same area. You can find more information in this regard here:
https://landweb.modaps.eosdis.nasa.gov/cgi-bin/QA_WWW/displayCase.cgi?esdt=MOD&caseNum=PM_MOD_21264&caseLocation=cases_data&type=C6

and here:
https://landweb.modaps.eosdis.nasa.gov/cgi-bin/QA_WWW/displayCase.cgi?esdt=MYD&caseNum=AS_MYD_21278&caseLocation=cases_data&type=C6
Regards,
LAADS User Services

To receive news from LAADS DAAC direct to your inbox, email laadsdaac-join@lists.nasa.gov with “subscribe” in the subject line.

LAADS_UserServices_M
User Services
User Services
Posts: 297
Joined: Mon Sep 30, 2019 8:33 am America/New_York
Answers: 1
Has thanked: 3 times

Re: Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by LAADS_UserServices_M » Tue May 30, 2023 7:57 am America/New_York

Also, the Dark Target AOD cannot be retrieved over brighter surfaces. So, you may be getting confused by an apparent pattern that forms over the equatorial and tropical areas, where most of the areas are brighter because of clouds and deserts, and so there is not much retrieval of DT AOD, creating often empty patches across the middle of the swath. The sun-glint over those equatorial areas is another big factor.
Regards,
LAADS User Services

To receive news from LAADS DAAC direct to your inbox, email laadsdaac-join@lists.nasa.gov with “subscribe” in the subject line.

LAADS_UserServices_M
User Services
User Services
Posts: 297
Joined: Mon Sep 30, 2019 8:33 am America/New_York
Answers: 1
Has thanked: 3 times

Re: Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by LAADS_UserServices_M » Wed May 31, 2023 6:19 am America/New_York

We further looked into the granules to check the Aerosol Optical Depth (AOD) pattern you reported and below is the summery:

The Missing Aerosol Optical Data (AOD) is not the systematic issue. ​
They are relevant to the pixel selections. For the following conditions, the AOD values will be​ fill values:​

Over Ocean:​
· Bright Ocean reflectance; ​
· High cloud fraction​
· Over ocean: glint angle < 40 deg and Refl_0.47/Refl_0.66 >= 0.95​
· If AOD > 5 or AOD < -0.01, then report fill values.​

Over Land:​
· If angles and reflectance values are invalid, then AOD will be value.​
· For cloudy and snow/ice pixels.​
· For non “dark target pixels” (Refl_2.13um is outside [0.01, 0.25]​
· According to ρ0.66, discard brightest 50% and darkest 25% of pixels, ​
· If AOD > 5 or AOD < -0.01, then report fill values.
Regards,
LAADS User Services

To receive news from LAADS DAAC direct to your inbox, email laadsdaac-join@lists.nasa.gov with “subscribe” in the subject line.

laxmi1000
Posts: 4
Joined: Fri May 19, 2023 9:56 am America/New_York
Answers: 0

Re: Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by laxmi1000 » Tue Jun 13, 2023 10:10 am America/New_York

Dear LAADS_UserServices_M,

Thank you so much for the detailed explanation!
Basically, swaths in the Pacific regions are missing AOD values around the middle column of the granules. In terms of fill values, just to be clear with the concept, one of the granules has following details:
{'Cell_Across_Swath_Sampling': [1, 1354, 10],
'Cell_Along_Swath_Sampling': [1, 2021, 10],
'Geolocation_Pointer': 'Internal geolocation arrays',
'Parameter_Type': 'Output',
'_FillValue': -9999,
'add_offset': 0.0,
'long_name': 'Combined Dark Target, Deep Blue AOT at 0.55 micron for land and ocean.',
'scale_factor': 0.0010000000474974513,
'units': 'None',
'valid_range': [-100, 5000]}

Isn't this fill value already is added during the AOD values retrieval for the condition you have mentioned previously? And, in this case -9999 is basically the one to be removed from the data?

Many thanks in advance for your response!

Kind Regards,
Laxmi

LAADS_UserServices_M
User Services
User Services
Posts: 297
Joined: Mon Sep 30, 2019 8:33 am America/New_York
Answers: 1
Has thanked: 3 times

Re: Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by LAADS_UserServices_M » Tue Jun 13, 2023 11:29 am America/New_York

Yes, you are correct.
Regards,
LAADS User Services

To receive news from LAADS DAAC direct to your inbox, email laadsdaac-join@lists.nasa.gov with “subscribe” in the subject line.

laxmi1000
Posts: 4
Joined: Fri May 19, 2023 9:56 am America/New_York
Answers: 0

Re: Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by laxmi1000 » Wed Jun 14, 2023 4:11 am America/New_York

Dear LAADS_UserServices_Mm

Many thanks for the quick response and explanation. In such missing case, would it be a good idea to fill up the missing values by making sub-grid and applying different imputation techniques?
As an additional query, I am wondering if there is an example python code or case studies extracting time series AOD Values for multiple location all at once?

Kind Regards,
Laxmi

LAADS_UserServices_M
User Services
User Services
Posts: 297
Joined: Mon Sep 30, 2019 8:33 am America/New_York
Answers: 1
Has thanked: 3 times

Re: Missing Aerosol Optical Depth (AOD) Data in MYD04_L2

by LAADS_UserServices_M » Wed Jun 14, 2023 12:55 pm America/New_York

No, there are no python code examples available at LAADS. However, you may want to check with "HDF-EOS TOOLS AND INFORMATION CENTER", they have Python code example to work with MODIS data. Their website is
https://www.hdfeos.org/
Regards,
LAADS User Services

To receive news from LAADS DAAC direct to your inbox, email laadsdaac-join@lists.nasa.gov with “subscribe” in the subject line.

Post Reply