Horizontal lines in MODIS Aqua data counts

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
emaure
Posts: 27
Joined: Tue Mar 26, 2013 7:18 am America/New_York
Answers: 0

Horizontal lines in MODIS Aqua data counts

by emaure » Mon Jun 10, 2019 10:40 pm America/New_York

Hi everyone,

I got a little confused while compositing monthly chlorophyll-a images of MODIS-Aqua for the period 2003-2018.

While compositing the data I also was created the counts of valid pixels, that is, the number of pixels that contributed to the composite. So, in a year, I would know which points had valid pixels for the 12 months.

The issue is that when I look at the [img TOP]count image[/img] I see horizontal lines that I do not understand their origin. These lines become even clear with [img MIDDLE]more years[/img] combined. Looking at the monthly chlorophyll images it seems to me the missing values are random and I do not see any tendency for the straight lines that appear on counts.

I computed the counts using different software and this issue is present independent of the software used. However, using [img BOTTOM]Google Earth Engine[/img], the problem is not there and the distribution of the counts looks more natural to me.

So, what might be the issue?
I appreciate your kind help in understanding the reason for this issue.
Thanks in advance for your consideration.
Sincerely,
Eligio



Filters:

OB SeaDAS - dshea
Subject Matter Expert
Subject Matter Expert
Posts: 263
Joined: Thu Mar 05, 2009 10:25 am America/New_York
Answers: 0
Been thanked: 2 times

Horizontal lines in MODIS Aqua data counts

by OB SeaDAS - dshea » Tue Jun 11, 2019 11:12 am America/New_York

This is what our mission composite looks like for the number of chl observations for the aqua mission.  Our composite is created like this:

l2bin - scenes -> daily
l3bin - dailies -> 8day
l3bin - 8days+dailies -> monthly
l3bin - monthlies -> yearly
l3bin - yearlies -> mission

emaure
Posts: 27
Joined: Tue Mar 26, 2013 7:18 am America/New_York
Answers: 0

Horizontal lines in MODIS Aqua data counts

by emaure » Thu Jun 13, 2019 10:10 pm America/New_York

Your count image looks the way I expected.
I forgot to mention that I am constructing the composite from monthly SMI images obtained from this website.
I have tried again but I still get the [img]strange count image[/img]

gnwiii
Posts: 713
Joined: Fri Jan 29, 2021 5:51 pm America/New_York
Answers: 2
Has thanked: 1 time

Horizontal lines in MODIS Aqua data counts

by gnwiii » Fri Jun 14, 2019 6:59 am America/New_York

The horizontal lines artifacts give a hint that your workflow is not appropriate for these data.  MODIS (topic 10510) provides some background that may help you understand why the workflow in Don Shea's post is appropriate.  Your post, does however, provide a valuable demonstration of the importance of using appropriate (e.g. OCSSW Processing System) tools for these data.  

It is worth mentioning that the OCSSW programs Don used were originally developed for SeaWiFS data in the 1990's, which means they run well on systems that were much less powerful and orders of magnitude more expensive than today's smartphones.  Many organizations have a collection of older unloved and unwanted PC's and laptops that can make very useful headless (text only) OCSSW processing platforms for the price of a big disk.

emaure
Posts: 27
Joined: Tue Mar 26, 2013 7:18 am America/New_York
Answers: 0

Horizontal lines in MODIS Aqua data counts

by emaure » Thu Oct 31, 2019 4:37 am America/New_York

Thanks for the background information.
But I still have cannot fully understand why I am getting the lines.
From the explanation I get the sense that the horizontal lines are caused by the difference between l3bin and l3m?
Then, not appropriate means l3m should not be used for any statistics as I got the counts from daily standard mapped images
Thanks
Eligio

gnwiii
Posts: 713
Joined: Fri Jan 29, 2021 5:51 pm America/New_York
Answers: 2
Has thanked: 1 time

Horizontal lines in MODIS Aqua data counts

by gnwiii » Thu Oct 31, 2019 8:46 am America/New_York

Artifacts such as those you observed are not unusual for when mapped data are reprocessed.   Understanding the exact details of an artifact would require details of the original mapping as well as the final processing steps.  If you want to fully understand the artifacts, I suggest you  pick a few pixels near an artifact.  Extract the values for these locations from each input image and do your calculation by hand.

In general, mapped data are visualizations. Different workflows should be used to generate statistical products, which can then be used in visualizations.

IOCCG Report 4 may be helpful.

OB WebDev - norman
Subject Matter Expert
Subject Matter Expert
Posts: 143
Joined: Tue Feb 09, 2021 8:19 am America/New_York
Answers: 0

Horizontal lines in MODIS Aqua data counts

by OB WebDev - norman » Thu Oct 31, 2019 8:53 am America/New_York

Hi Eligio,

As far as I am aware, we do not distribute SMI count files.
Which SMI files are you using?   If you want a proper image
showing the valid number of observations at any location,
then you should be using the L3 bin files as Don and George
suggested.

Regards,
Norman

emaure
Posts: 27
Joined: Tue Mar 26, 2013 7:18 am America/New_York
Answers: 0

Horizontal lines in MODIS Aqua data counts

by emaure » Thu Oct 31, 2019 11:27 pm America/New_York

Thank you folks,
I start to get the point. I may look at some of your suggestions.
The SMI I used is monthly "A*L3m_MO_CHL_chlor_a_4km.nc" provided in this website.
And yes, it does not come with counts, I calculated those myself.
Again thanks for your clarification
Eligio

Post Reply