missing_value ?

Use this Forum to find information on, or ask a question about, NASA Earth Science data.
Post Reply
pleonard
Posts: 2
Joined: Wed May 31, 2023 11:14 pm America/New_York
Answers: 0

missing_value ?

by pleonard » Thu Jun 01, 2023 10:23 pm America/New_York

Under what circumstances should I use the missing_value attribute in my Earth Science data product?

LP DAAC - dgolon
User Services
User Services
Posts: 283
Joined: Mon Sep 30, 2019 10:00 am America/New_York
Answers: 0
Has thanked: 15 times
Been thanked: 2 times
Contact:

Re: missing_value ?

by LP DAAC - dgolon » Mon Jun 05, 2023 4:32 pm America/New_York

Hi @pleonard Could you please provide us with a little more information? I.e. which dataset are you using and what are you trying to accomplish?
Subscribe to the LP DAAC listserv by sending a blank email to lpdaac-join@lists.nasa.gov.

Sign up for the Landsat listserv to receive the most up to date information about Landsat data: https://public.govdelivery.com/accounts/USDOIGS/subscriber/new#tab1.

pleonard
Posts: 2
Joined: Wed May 31, 2023 11:14 pm America/New_York
Answers: 0

Re: missing_value ?

by pleonard » Mon Jun 05, 2023 11:15 pm America/New_York

I am producing a gridded soil-moisture product in netCDF.

The data in each grid cell can be either high quality, low quality or missing.

There are many reasons for why data can be missing from a grid cell, and I think it is worth noting why the data are missing in each case.

How should I represent these different cases of missing data in my product?

ORNL - yaxingwei
Subject Matter Expert
Subject Matter Expert
Posts: 40
Joined: Thu May 27, 2021 2:52 pm America/New_York
Answers: 0

Re: missing_value ?

by ORNL - yaxingwei » Tue Jun 06, 2023 12:16 am America/New_York

Hi @pleonard, in general the netCDF CF convention (http://cfconventions.org/) provides two attributes that you can use to specify a single missing value, one is _FillValue and the other is missing_value. But _FillValue is preferred as your data will get better support from the netCDF library. Here are some example cases that _FillValue can be use in: 1) you want to assign a _FillValue to grid cells falling within water bodies; and 2) if your soil moisture data is a time series but you couldn't produce data at certain time periods due to sensor failure or other reasons.

To specify quality level of your data, the CF convention suggests you define ancillary variables. Here are some examples for your reference:
- Ancillary quality flag data: http://cfconventions.org/Data/cf-conventions/cf-conventions-1.10/cf-conventions.html#quality-flag-ex
- A flag variable, using flag_values: http://cfconventions.org/Data/cf-conventions/cf-conventions-1.10/cf-conventions.html#flag-variable-flag-values-ex

Hope this helps.
Dr. Yaxing Wei (weiy@ornl.gov)
Lead Scientist, ORNL DAAC
Environmental Sciences Division
Oak Ridge National Laboratory
https://daac.ornl.gov

Post Reply